2024-05-09T07:44:02.352 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T07:44:02.352 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636 --name teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --verbose --description fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_blogbench traceless/50pc} -- /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/orig.config.yaml 2024-05-09T07:44:02.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T07:44:02.523 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636 branch: squid description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_blogbench traceless/50pc} email: ceph-qa@ceph.com first_in_suite: false job_id: '7698636' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds inject traceless reply probability: 0.5 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: be85c202969d25af6e130678e7d73a20e9c4ca11 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 2334 sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc sleep_before_teardown: 0 subset: 359/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_be85c202969d25af6e130678e7d73a20e9c4ca11/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: be85c202969d25af6e130678e7d73a20e9c4ca11 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPn7ZtjXs0xXVrD5FfDviomc40eyBdvdJM1K/sbPzAlWXuMNQ4o7EUSkR9/olHt+ten3F24LgLr3IbW9bYajNec= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlEbrcInhO3xxuJpVhRCwm/WHXvjvEfoKY+fvHxJ3yTy8XEJcY1EXx8oAdX6c1JzePO3forA5JGB2rCpLwbrz8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - check-counter: counters: mds: - mds.dir_split - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_21:24:04 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T07:44:02.524 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_be85c202969d25af6e130678e7d73a20e9c4ca11/qa; will attempt to use it 2024-05-09T07:44:02.525 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_be85c202969d25af6e130678e7d73a20e9c4ca11/qa/tasks 2024-05-09T07:44:02.525 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T07:44:02.527 INFO:teuthology.task.internal:Checking packages... 2024-05-09T07:44:02.553 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc' 2024-05-09T07:44:02.553 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T07:44:02.553 INFO:teuthology.packaging:ref: None 2024-05-09T07:44:02.553 INFO:teuthology.packaging:tag: None 2024-05-09T07:44:02.553 INFO:teuthology.packaging:branch: squid 2024-05-09T07:44:02.553 INFO:teuthology.packaging:sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-09T07:44:02.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-05-09T07:44:02.868 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2529.gbf77c77e 2024-05-09T07:44:02.869 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T07:44:02.875 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T07:44:02.875 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T07:44:02.882 INFO:teuthology.task.internal:Saving configuration 2024-05-09T07:44:02.904 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T07:44:02.910 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T07:44:02.935 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 07:39:01.041380', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPn7ZtjXs0xXVrD5FfDviomc40eyBdvdJM1K/sbPzAlWXuMNQ4o7EUSkR9/olHt+ten3F24LgLr3IbW9bYajNec='} 2024-05-09T07:44:02.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 07:39:01.039734', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlEbrcInhO3xxuJpVhRCwm/WHXvjvEfoKY+fvHxJ3yTy8XEJcY1EXx8oAdX6c1JzePO3forA5JGB2rCpLwbrz8='} 2024-05-09T07:44:02.959 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T07:44:02.965 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-09T07:44:02.965 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-09T07:44:02.965 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T07:44:03.042 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f45a29463a0>, signals=[15]) 2024-05-09T07:44:03.043 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T07:44:03.049 INFO:teuthology.task.internal:Opening connections... 2024-05-09T07:44:03.049 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T07:44:03.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T07:44:03.128 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T07:44:03.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T07:44:03.203 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T07:44:03.212 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-05-09T07:44:03.230 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-05-09T07:44:03.231 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-05-09T07:44:03.288 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-05-09T07:44:03.288 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-05-09T07:44:03.288 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-05-09T07:44:03.288 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-05-09T07:44:03.288 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-05-09T07:44:03.288 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-05-09T07:44:03.288 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T07:44:03.289 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-05-09T07:44:03.289 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-05-09T07:44:03.289 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T07:44:03.289 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-05-09T07:44:03.289 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T07:44:03.289 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T07:44:03.289 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T07:44:03.290 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-05-09T07:44:03.310 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-05-09T07:44:03.329 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-05-09T07:44:03.329 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-05-09T07:44:03.387 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-05-09T07:44:03.387 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-05-09T07:44:03.387 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T07:44:03.388 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T07:44:03.388 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-05-09T07:44:03.411 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T07:44:03.424 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T07:44:03.464 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T07:44:03.464 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-05-09T07:44:03.467 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-05-09T07:44:03.483 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T07:44:03.496 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T07:44:03.496 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-05-09T07:44:03.524 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-05-09T07:44:03.617 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T07:44:03.678 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T07:44:03.693 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-09T07:44:03.693 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-09T07:44:03.694 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T07:44:03.694 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T07:44:03.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T07:44:03.711 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-05-09T07:44:03.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T07:44:03.712 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-05-09T07:44:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-437.el9.x86_64 2024-05-09T07:44:03.768 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.14.0-437.el9.x86_64 2024-05-09T07:44:03.768 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2024-05-09T07:44:03.769 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-437.el9.x86_64 2024-05-09T07:44:03.769 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.14.0-437.el9.x86_64 2024-05-09T07:44:03.769 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum install -y kernel 2024-05-09T07:44:07.234 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.1 MB 00:01 2024-05-09T07:44:07.799 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.1 MB 00:02 2024-05-09T07:44:11.200 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 19 MB 00:02 2024-05-09T07:44:16.684 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-05-09T07:44:18.385 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 16 kB 00:00 2024-05-09T07:44:20.100 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 1.6 MB/s | 19 MB 00:11 2024-05-09T07:44:21.447 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 7.2 MB/s | 21 MB 00:02 2024-05-09T07:44:25.509 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-05-09T07:44:26.678 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-09T07:44:27.162 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-05-09T07:44:28.684 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T07:44:28.684 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T07:44:28.769 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-09T07:44:28.777 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-09T07:44:28.777 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-05-09T07:44:28.777 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-09T07:44:28.777 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-09T07:44:28.777 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T07:44:28.777 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-09T07:44:28.778 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T07:44:28.778 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T07:44:28.778 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T07:44:28.778 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:44:28.778 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-09T07:44:28.778 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-05-09T07:44:28.778 INFO:teuthology.orchestra.run.smithi087.stdout:Install 4 Packages 2024-05-09T07:44:28.778 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:44:28.779 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 78 M 2024-05-09T07:44:28.779 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 123 M 2024-05-09T07:44:28.779 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-09T07:44:28.929 INFO:teuthology.orchestra.run.smithi087.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 4.4 MB/s | 484 kB 00:00 2024-05-09T07:44:29.355 INFO:teuthology.orchestra.run.smithi087.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 29 MB/s | 15 MB 00:00 2024-05-09T07:44:30.046 INFO:teuthology.orchestra.run.smithi087.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 28 MB/s | 34 MB 00:01 2024-05-09T07:44:30.405 INFO:teuthology.orchestra.run.smithi087.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 19 MB/s | 28 MB 00:01 2024-05-09T07:44:30.405 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-09T07:44:30.405 INFO:teuthology.orchestra.run.smithi087.stdout:Total 48 MB/s | 78 MB 00:01 2024-05-09T07:44:31.079 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-09T07:44:31.416 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-09T07:44:31.416 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-09T07:44:32.340 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-09T07:44:32.340 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-09T07:44:34.741 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-09T07:44:35.350 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T07:44:35.438 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T07:44:36.730 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 2.2 MB/s | 21 MB 00:09 2024-05-09T07:44:38.084 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T07:44:38.217 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T07:44:41.802 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-09T07:44:42.930 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T07:44:43.036 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:44:43.833 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T07:44:43.833 INFO:teuthology.orchestra.run.smithi110.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T07:44:43.927 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-05-09T07:44:43.941 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-05-09T07:44:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-05-09T07:44:43.941 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-05-09T07:44:43.941 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout:Install 4 Packages 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 78 M 2024-05-09T07:44:43.942 INFO:teuthology.orchestra.run.smithi110.stdout:Installed size: 123 M 2024-05-09T07:44:43.943 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-05-09T07:44:44.396 INFO:teuthology.orchestra.run.smithi110.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.7 MB/s | 484 kB 00:00 2024-05-09T07:44:44.696 INFO:teuthology.orchestra.run.smithi110.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 32 MB/s | 15 MB 00:00 2024-05-09T07:44:45.113 INFO:teuthology.orchestra.run.smithi110.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 38 MB/s | 34 MB 00:00 2024-05-09T07:44:45.448 INFO:teuthology.orchestra.run.smithi110.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 27 MB/s | 28 MB 00:01 2024-05-09T07:44:45.448 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-05-09T07:44:45.448 INFO:teuthology.orchestra.run.smithi110.stdout:Total 52 MB/s | 78 MB 00:01 2024-05-09T07:44:46.127 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-05-09T07:44:46.466 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-05-09T07:44:46.466 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-05-09T07:44:47.392 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-05-09T07:44:47.392 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-05-09T07:44:47.762 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:44:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-05-09T07:44:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T07:44:50.480 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T07:44:53.127 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T07:44:53.261 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T07:44:58.004 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T07:44:58.130 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:02.894 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:17.224 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:17.263 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:17.617 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:17.618 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T07:45:17.618 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T07:45:17.618 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T07:45:18.441 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:18.441 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:45:18.442 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-09T07:45:18.442 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T07:45:18.442 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T07:45:18.442 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T07:45:18.442 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T07:45:18.442 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:45:18.442 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-09T07:45:18.788 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T07:45:18.859 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T07:45:18.859 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T07:45:18.859 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T07:45:18.860 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T07:45:18.860 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T07:45:18.860 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-09T07:45:18.860 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T07:45:18.860 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T07:45:18.909 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T07:45:18.910 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T07:45:18.910 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-05-09T07:45:18.945 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-05-09T07:45:18.945 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-05-09T07:45:18.945 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.06 2024-05-09T07:45:18.945 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 68.el9 2024-05-09T07:45:18.945 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-05-09T07:45:18.945 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T07:45:18.945 INFO:teuthology.orchestra.run.smithi087.stdout:Group : Unspecified 2024-05-09T07:45:18.945 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 8264254 2024-05-09T07:45:18.945 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : builder@centos.org 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-05-09T07:45:18.946 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:45:18.947 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T07:45:18.947 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T07:45:18.947 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 5.14.0-444.el9.x86_64 2024-05-09T07:45:18.948 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T07:45:19.566 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-05-09T07:45:20.880 INFO:teuthology.orchestra.run.smithi087.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T07:45:20.910 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-05-09T07:45:20.912 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-05-09T07:45:20.931 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.UWJknR0KQx 2024-05-09T07:45:20.931 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.UWJknR0KQx 2024-05-09T07:45:21.001 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.UWJknR0KQx 2024-05-09T07:45:21.138 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.UWJknR0KQx is 6KB 2024-05-09T07:45:21.186 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.UWJknR0KQx 2024-05-09T07:45:21.200 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T07:45:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T07:45:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T07:45:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T07:45:21.263 INFO:teuthology.orchestra.run.smithi087.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T07:45:21.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T07:45:21.407 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-05-09T07:45:32.188 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:32.226 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:32.612 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:32.612 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T07:45:32.612 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T07:45:32.612 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T07:45:33.482 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T07:45:33.482 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:45:33.482 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-05-09T07:45:33.482 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T07:45:33.483 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T07:45:33.483 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T07:45:33.483 INFO:teuthology.orchestra.run.smithi110.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T07:45:33.483 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:45:33.483 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-05-09T07:45:33.827 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T07:45:33.897 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T07:45:33.897 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T07:45:33.897 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T07:45:33.897 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T07:45:33.897 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T07:45:33.897 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-09T07:45:33.898 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T07:45:33.898 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T07:45:33.947 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T07:45:33.947 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T07:45:33.948 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-05-09T07:45:33.984 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-05-09T07:45:33.984 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-05-09T07:45:33.984 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-05-09T07:45:33.984 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 68.el9 2024-05-09T07:45:33.984 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-05-09T07:45:33.984 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T07:45:33.984 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-05-09T07:45:33.984 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8264254 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T07:45:33.985 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-05-09T07:45:33.986 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:45:33.986 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T07:45:33.986 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T07:45:33.987 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 5.14.0-444.el9.x86_64 2024-05-09T07:45:33.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T07:45:34.593 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-05-09T07:45:36.045 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T07:45:36.061 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-05-09T07:45:36.064 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-05-09T07:45:36.079 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.FhldtVtv6d 2024-05-09T07:45:36.079 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FhldtVtv6d 2024-05-09T07:45:36.145 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.FhldtVtv6d 2024-05-09T07:45:36.282 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.FhldtVtv6d is 6KB 2024-05-09T07:45:36.331 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.FhldtVtv6d 2024-05-09T07:45:36.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T07:45:36.415 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T07:45:36.415 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T07:45:36.415 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T07:45:36.415 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T07:45:36.416 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T07:45:36.561 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-05-09T07:45:51.422 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-09T07:45:51.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-09T07:45:51.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T07:46:06.574 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-09T07:46:06.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T07:46:06.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T07:46:51.471 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T07:47:00.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-09T07:47:00.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T07:47:01.122 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-05-09T07:47:01.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-09T07:47:01.586 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-09T07:47:01.586 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-05-09T07:47:01.601 INFO:teuthology.orchestra.run.smithi087.stdout:5.14.0-444.el9.x86_64 2024-05-09T07:47:01.601 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T07:47:01.601 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T07:47:01.601 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T07:47:02.602 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-09T07:47:02.602 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T07:47:02.686 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-05-09T07:47:02.730 DEBUG:teuthology.parallel:result is None 2024-05-09T07:47:06.577 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T07:47:15.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T07:47:15.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T07:47:18.959 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-05-09T07:47:19.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T07:47:19.457 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-444.el9.x86_64"... 2024-05-09T07:47:19.458 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-05-09T07:47:19.472 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-444.el9.x86_64 2024-05-09T07:47:19.473 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T07:47:19.473 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T07:47:19.473 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T07:47:20.474 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-09T07:47:20.474 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-09T07:47:20.562 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-05-09T07:47:20.595 DEBUG:teuthology.parallel:result is None 2024-05-09T07:47:20.596 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T07:47:20.602 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T07:47:20.603 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T07:47:20.607 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T07:47:20.624 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T07:47:20.630 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T07:47:20.640 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T07:47:20.641 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T07:47:20.667 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T07:47:20.766 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T07:47:20.773 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T07:47:20.773 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T07:47:20.776 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T07:47:20.804 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T07:47:20.816 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T07:47:20.829 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T07:47:20.839 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T07:47:20.841 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T07:47:20.848 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T07:47:20.848 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T07:47:20.860 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T07:47:20.884 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T07:47:20.918 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T07:47:20.918 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T07:47:20.928 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T07:47:20.943 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T07:47:21.027 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T07:47:21.077 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T07:47:21.159 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T07:47:21.201 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:47:21.201 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T07:47:21.266 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T07:47:21.310 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T07:47:21.355 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T07:47:21.439 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T07:47:21.479 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:47:21.479 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T07:47:21.551 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-05-09T07:47:21.554 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-05-09T07:47:21.594 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T07:47:21.640 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T07:47:21.957 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T07:47:21.964 INFO:teuthology.task.internal:Starting timer... 2024-05-09T07:47:21.964 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T07:47:21.980 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T07:47:21.990 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-09T07:47:21.991 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-05-09T07:47:22.096 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-05-09T07:47:22.098 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-05-09T07:47:22.166 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-05-09T07:47:22.168 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T07:47:22.169 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-05-09T07:47:22.201 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-05-09T07:47:22.201 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-05-09T07:47:22.224 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-05-09T07:47:22.224 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive'} 2024-05-09T07:47:22.224 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T07:47:22.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T07:47:22.267 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T07:47:22.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T07:47:22.293 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T07:47:22.293 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-05-09T07:47:22.332 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-05-09T07:47:22.357 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T07:47:22.389 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-09T07:47:22.453 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-09T07:47:27.160 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T07:47:28.002 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T07:47:28.004 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi087.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T07:51:38.419 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-05-09T07:51:38.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-09T07:51:38.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T07:51:38.501 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-05-09T07:51:38.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-05-09T07:51:38.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T07:51:38.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T07:51:38.657 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-05-09T07:51:38.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-05-09T07:51:38.739 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T07:51:38.749 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T07:51:38.749 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T07:51:38.749 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T07:51:38.752 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T07:51:38.752 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T07:51:38.779 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T07:51:38.793 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T07:51:38.808 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T07:51:38.817 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-05-09T07:51:38.822 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T07:51:38.828 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-05-09T07:51:38.842 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T07:51:38.845 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-05-09T07:51:38.855 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T07:51:38.857 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-05-09T07:51:38.870 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T07:51:38.884 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T07:51:38.911 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-05-09T07:51:38.915 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T07:51:38.915 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-05-09T07:51:38.915 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T07:51:38.915 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T07:51:38.915 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T07:51:38.915 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T07:51:38.940 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-05-09T07:51:38.946 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T07:51:38.946 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-05-09T07:51:38.946 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T07:51:38.946 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T07:51:38.946 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T07:51:38.946 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T07:51:38.947 INFO:teuthology.run_tasks:Running task install... 2024-05-09T07:51:38.955 DEBUG:teuthology.task.install:project ceph 2024-05-09T07:51:38.955 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'}} 2024-05-09T07:51:38.955 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'} 2024-05-09T07:51:38.955 INFO:teuthology.task.install:Using flavor: default 2024-05-09T07:51:38.961 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T07:51:38.961 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-09T07:51:38.962 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc', 'tag': None, 'wait_for_package': False} 2024-05-09T07:51:38.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-09T07:51:38.964 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc', 'tag': None, 'wait_for_package': False} 2024-05-09T07:51:38.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-09T07:51:39.107 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/ 2024-05-09T07:51:39.107 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2515.g96805dcf 2024-05-09T07:51:39.113 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/ 2024-05-09T07:51:39.113 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2515.g96805dcf 2024-05-09T07:51:39.214 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T07:51:39.215 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:51:39.215 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T07:51:39.240 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T07:51:39.240 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T07:51:39.288 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T07:51:39.288 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:51:39.288 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T07:51:39.305 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T07:51:39.313 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T07:51:39.314 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T07:51:39.379 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T07:51:39.380 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T07:51:39.444 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-05-09T07:51:39.445 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-05-09T07:51:39.454 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T07:51:39.518 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-05-09T07:51:39.520 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-05-09T07:51:39.692 INFO:teuthology.orchestra.run.smithi087.stdout:54 files removed 2024-05-09T07:51:39.719 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T07:51:39.756 INFO:teuthology.orchestra.run.smithi110.stdout:54 files removed 2024-05-09T07:51:39.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T07:51:40.514 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 182 kB/s | 83 kB 00:00 2024-05-09T07:51:40.571 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 144 kB/s | 83 kB 00:00 2024-05-09T07:51:40.914 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-05-09T07:51:40.972 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-05-09T07:51:41.298 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2024-05-09T07:51:41.389 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-05-09T07:51:42.981 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.1 MB 00:01 2024-05-09T07:51:46.990 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 19 MB 00:02 2024-05-09T07:51:52.391 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-05-09T07:51:54.025 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-09T07:51:54.914 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 608 kB/s | 8.1 MB 00:13 2024-05-09T07:51:55.785 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-09T07:51:56.907 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-05-09T07:52:00.911 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-09T07:52:01.199 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.2 MB 00:00 2024-05-09T07:52:02.667 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 16 kB 00:00 2024-05-09T07:52:03.262 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T07:52:03.263 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T07:52:03.274 INFO:teuthology.orchestra.run.smithi087.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T07:52:03.275 INFO:teuthology.orchestra.run.smithi087.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T07:52:03.276 INFO:teuthology.orchestra.run.smithi087.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T07:52:03.277 INFO:teuthology.orchestra.run.smithi087.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T07:52:03.278 INFO:teuthology.orchestra.run.smithi087.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T07:52:03.280 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T07:52:03.281 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T07:52:03.342 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-05-09T07:52:03.365 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-05-09T07:52:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-05-09T07:52:03.365 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-05-09T07:52:03.365 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-05-09T07:52:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T07:52:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 6.6 k 2024-05-09T07:52:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 5.4 M 2024-05-09T07:52:03.365 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 889 k 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 145 k 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 1.5 M 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 142 k 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 3.5 M 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 7.4 M 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 49 k 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 10 M 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 48 M 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 264 k 2024-05-09T07:52:03.366 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 763 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 222 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 27 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 18 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 32 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 746 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 127 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T07:52:03.367 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 162 k 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 321 k 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 298 k 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 99 k 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 85 k 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.1 M 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 171 k 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-05-09T07:52:03.368 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.4 M 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.1 M 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T07:52:03.369 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 21 M 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 32 k 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 2.4 M 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 249 k 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 4.7 M 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 17 M 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 16 k 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 25 k 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T07:52:03.370 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 163 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T07:52:03.371 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 500 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 5.3 M 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T07:52:03.372 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 45 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 135 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T07:52:03.373 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T07:52:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T07:52:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T07:52:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T07:52:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T07:52:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T07:52:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T07:52:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T07:52:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T07:52:03.374 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T07:52:03.375 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T07:52:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T07:52:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T07:52:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T07:52:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T07:52:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T07:52:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T07:52:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T07:52:03.376 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T07:52:03.377 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T07:52:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T07:52:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T07:52:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T07:52:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T07:52:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T07:52:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T07:52:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T07:52:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T07:52:03.378 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T07:52:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T07:52:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T07:52:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T07:52:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T07:52:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T07:52:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T07:52:03.379 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T07:52:03.380 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2024-05-09T07:52:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T07:52:03.380 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:52:03.380 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-05-09T07:52:03.380 INFO:teuthology.orchestra.run.smithi087.stdout:======================================================================================= 2024-05-09T07:52:03.380 INFO:teuthology.orchestra.run.smithi087.stdout:Install 148 Packages 2024-05-09T07:52:03.380 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 8 Packages 2024-05-09T07:52:03.381 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:52:03.381 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 225 M 2024-05-09T07:52:03.382 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-05-09T07:52:03.821 INFO:teuthology.orchestra.run.smithi087.stdout:(1/156): ceph-19.0.0-2515.g96805dcf.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-05-09T07:52:04.038 INFO:teuthology.orchestra.run.smithi087.stdout:(2/156): ceph-fuse-19.0.0-2515.g96805dcf.el9.x8 4.0 MB/s | 889 kB 00:00 2024-05-09T07:52:04.088 INFO:teuthology.orchestra.run.smithi087.stdout:(3/156): ceph-immutable-object-cache-19.0.0-251 2.8 MB/s | 145 kB 00:00 2024-05-09T07:52:04.388 INFO:teuthology.orchestra.run.smithi087.stdout:(4/156): ceph-base-19.0.0-2515.g96805dcf.el9.x8 7.3 MB/s | 5.4 MB 00:00 2024-05-09T07:52:04.438 INFO:teuthology.orchestra.run.smithi087.stdout:(5/156): ceph-mds-19.0.0-2515.g96805dcf.el9.x86 6.7 MB/s | 2.4 MB 00:00 2024-05-09T07:52:04.555 INFO:teuthology.orchestra.run.smithi087.stdout:(6/156): ceph-mgr-19.0.0-2515.g96805dcf.el9.x86 9.0 MB/s | 1.5 MB 00:00 2024-05-09T07:52:04.671 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-09T07:52:04.964 INFO:teuthology.orchestra.run.smithi087.stdout:(7/156): ceph-mon-19.0.0-2515.g96805dcf.el9.x86 8.9 MB/s | 4.7 MB 00:00 2024-05-09T07:52:06.089 INFO:teuthology.orchestra.run.smithi087.stdout:(8/156): ceph-osd-19.0.0-2515.g96805dcf.el9.x86 11 MB/s | 17 MB 00:01 2024-05-09T07:52:06.198 INFO:teuthology.orchestra.run.smithi087.stdout:(9/156): ceph-radosgw-19.0.0-2515.g96805dcf.el9 8.3 MB/s | 10 MB 00:01 2024-05-09T07:52:06.223 INFO:teuthology.orchestra.run.smithi087.stdout:(10/156): ceph-selinux-19.0.0-2515.g96805dcf.el 188 kB/s | 25 kB 00:00 2024-05-09T07:52:06.307 INFO:teuthology.orchestra.run.smithi087.stdout:(11/156): cephfs-mirror-19.0.0-2515.g96805dcf.e 2.6 MB/s | 222 kB 00:00 2024-05-09T07:52:06.390 INFO:teuthology.orchestra.run.smithi087.stdout:(12/156): cephfs-shell-19.0.0-2515.g96805dcf.el 325 kB/s | 27 kB 00:00 2024-05-09T07:52:06.474 INFO:teuthology.orchestra.run.smithi087.stdout:(13/156): libcephfs-devel-19.0.0-2515.g96805dcf 380 kB/s | 32 kB 00:00 2024-05-09T07:52:06.641 INFO:teuthology.orchestra.run.smithi087.stdout:(14/156): libcephfs2-19.0.0-2515.g96805dcf.el9. 4.4 MB/s | 746 kB 00:00 2024-05-09T07:52:06.699 INFO:teuthology.orchestra.run.smithi087.stdout:(15/156): libcephsqlite-19.0.0-2515.g96805dcf.e 2.7 MB/s | 163 kB 00:00 2024-05-09T07:52:06.750 INFO:teuthology.orchestra.run.smithi087.stdout:(16/156): librados-devel-19.0.0-2515.g96805dcf. 2.5 MB/s | 127 kB 00:00 2024-05-09T07:52:06.825 INFO:teuthology.orchestra.run.smithi087.stdout:(17/156): libradosstriper1-19.0.0-2515.g96805dc 6.5 MB/s | 500 kB 00:00 2024-05-09T07:52:07.600 INFO:teuthology.orchestra.run.smithi087.stdout:(18/156): ceph-common-19.0.0-2515.g96805dcf.el9 5.3 MB/s | 21 MB 00:03 2024-05-09T07:52:07.676 INFO:teuthology.orchestra.run.smithi087.stdout:(19/156): librgw2-19.0.0-2515.g96805dcf.el9.x86 6.3 MB/s | 5.3 MB 00:00 2024-05-09T07:52:07.701 INFO:teuthology.orchestra.run.smithi087.stdout:(20/156): python3-ceph-argparse-19.0.0-2515.g96 451 kB/s | 45 kB 00:00 2024-05-09T07:52:07.743 INFO:teuthology.orchestra.run.smithi087.stdout:(21/156): python3-ceph-common-19.0.0-2515.g9680 2.0 MB/s | 135 kB 00:00 2024-05-09T07:52:07.793 INFO:teuthology.orchestra.run.smithi087.stdout:(22/156): python3-cephfs-19.0.0-2515.g96805dcf. 1.7 MB/s | 162 kB 00:00 2024-05-09T07:52:07.843 INFO:teuthology.orchestra.run.smithi087.stdout:(23/156): python3-rados-19.0.0-2515.g96805dcf.e 3.1 MB/s | 321 kB 00:00 2024-05-09T07:52:07.893 INFO:teuthology.orchestra.run.smithi087.stdout:(24/156): python3-rbd-19.0.0-2515.g96805dcf.el9 2.9 MB/s | 298 kB 00:00 2024-05-09T07:52:07.919 INFO:teuthology.orchestra.run.smithi087.stdout:(25/156): python3-rgw-19.0.0-2515.g96805dcf.el9 1.3 MB/s | 99 kB 00:00 2024-05-09T07:52:07.986 INFO:teuthology.orchestra.run.smithi087.stdout:(26/156): rbd-fuse-19.0.0-2515.g96805dcf.el9.x8 923 kB/s | 85 kB 00:00 2024-05-09T07:52:08.111 INFO:teuthology.orchestra.run.smithi087.stdout:(27/156): rbd-nbd-19.0.0-2515.g96805dcf.el9.x86 1.3 MB/s | 171 kB 00:00 2024-05-09T07:52:08.212 INFO:teuthology.orchestra.run.smithi087.stdout:(28/156): ceph-grafana-dashboards-19.0.0-2515.g 318 kB/s | 32 kB 00:00 2024-05-09T07:52:08.337 INFO:teuthology.orchestra.run.smithi087.stdout:(29/156): ceph-mgr-cephadm-19.0.0-2515.g96805dc 1.1 MB/s | 142 kB 00:00 2024-05-09T07:52:08.387 INFO:teuthology.orchestra.run.smithi087.stdout:(30/156): rbd-mirror-19.0.0-2515.g96805dcf.el9. 6.6 MB/s | 3.1 MB 00:00 2024-05-09T07:52:09.288 INFO:teuthology.orchestra.run.smithi087.stdout:(31/156): ceph-mgr-dashboard-19.0.0-2515.g96805 3.7 MB/s | 3.5 MB 00:00 2024-05-09T07:52:09.397 INFO:teuthology.orchestra.run.smithi087.stdout:(32/156): ceph-mgr-modules-core-19.0.0-2515.g96 2.2 MB/s | 249 kB 00:00 2024-05-09T07:52:09.480 INFO:teuthology.orchestra.run.smithi087.stdout:(33/156): ceph-mgr-rook-19.0.0-2515.g96805dcf.e 593 kB/s | 49 kB 00:00 2024-05-09T07:52:09.613 INFO:teuthology.orchestra.run.smithi087.stdout:(34/156): ceph-mgr-diskprediction-local-19.0.0- 6.0 MB/s | 7.4 MB 00:01 2024-05-09T07:52:09.630 INFO:teuthology.orchestra.run.smithi087.stdout:(35/156): ceph-prometheus-alerts-19.0.0-2515.g9 109 kB/s | 16 kB 00:00 2024-05-09T07:52:09.672 INFO:teuthology.orchestra.run.smithi087.stdout:(36/156): ceph-volume-19.0.0-2515.g96805dcf.el9 4.4 MB/s | 264 kB 00:00 2024-05-09T07:52:09.731 INFO:teuthology.orchestra.run.smithi087.stdout:(37/156): cephfs-top-19.0.0-2515.g96805dcf.el9. 314 kB/s | 18 kB 00:00 2024-05-09T07:52:09.819 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-09T07:52:09.856 INFO:teuthology.orchestra.run.smithi087.stdout:(38/156): cephadm-19.0.0-2515.g96805dcf.el9.noa 3.3 MB/s | 763 kB 00:00 2024-05-09T07:52:10.098 INFO:teuthology.orchestra.run.smithi087.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 219 kB/s | 80 kB 00:00 2024-05-09T07:52:10.182 INFO:teuthology.orchestra.run.smithi087.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-05-09T07:52:10.232 INFO:teuthology.orchestra.run.smithi087.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-05-09T07:52:10.291 INFO:teuthology.orchestra.run.smithi087.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-09T07:52:10.366 INFO:teuthology.orchestra.run.smithi087.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-05-09T07:52:10.433 INFO:teuthology.orchestra.run.smithi087.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-09T07:52:10.500 INFO:teuthology.orchestra.run.smithi087.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-05-09T07:52:10.550 INFO:teuthology.orchestra.run.smithi087.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-05-09T07:52:10.634 INFO:teuthology.orchestra.run.smithi087.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-05-09T07:52:10.843 INFO:teuthology.orchestra.run.smithi087.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-05-09T07:52:10.901 INFO:teuthology.orchestra.run.smithi087.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-05-09T07:52:10.960 INFO:teuthology.orchestra.run.smithi087.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-05-09T07:52:10.977 INFO:teuthology.orchestra.run.smithi087.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 285 kB/s | 21 kB 00:00 2024-05-09T07:52:11.035 INFO:teuthology.orchestra.run.smithi087.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-05-09T07:52:11.061 INFO:teuthology.orchestra.run.smithi087.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-05-09T07:52:11.103 INFO:teuthology.orchestra.run.smithi087.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-05-09T07:52:11.161 INFO:teuthology.orchestra.run.smithi087.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-05-09T07:52:11.262 INFO:teuthology.orchestra.run.smithi087.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-05-09T07:52:11.312 INFO:teuthology.orchestra.run.smithi087.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-05-09T07:52:11.479 INFO:teuthology.orchestra.run.smithi087.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-05-09T07:52:11.621 INFO:teuthology.orchestra.run.smithi087.stdout:(59/156): libtool-2.4.6-45.el9.x86_64.rpm 4.0 MB/s | 582 kB 00:00 2024-05-09T07:52:11.705 INFO:teuthology.orchestra.run.smithi087.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.5 MB/s | 3.0 MB 00:00 2024-05-09T07:52:11.730 INFO:teuthology.orchestra.run.smithi087.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 234 kB/s | 25 kB 00:00 2024-05-09T07:52:11.755 INFO:teuthology.orchestra.run.smithi087.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-05-09T07:52:11.814 INFO:teuthology.orchestra.run.smithi087.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-05-09T07:52:11.839 INFO:teuthology.orchestra.run.smithi087.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-05-09T07:52:11.864 INFO:teuthology.orchestra.run.smithi087.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-05-09T07:52:12.137 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T07:52:12.138 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T07:52:12.149 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T07:52:12.150 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T07:52:12.151 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T07:52:12.151 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T07:52:12.153 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T07:52:12.155 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T07:52:12.156 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T07:52:12.216 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-05-09T07:52:12.236 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-05-09T07:52:12.236 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-05-09T07:52:12.236 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-05-09T07:52:12.236 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-05-09T07:52:12.236 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T07:52:12.236 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 6.6 k 2024-05-09T07:52:12.236 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 5.4 M 2024-05-09T07:52:12.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 889 k 2024-05-09T07:52:12.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 145 k 2024-05-09T07:52:12.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 1.5 M 2024-05-09T07:52:12.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 142 k 2024-05-09T07:52:12.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 3.5 M 2024-05-09T07:52:12.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 7.4 M 2024-05-09T07:52:12.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 49 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 10 M 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 48 M 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 264 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 763 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 222 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 27 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 18 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 32 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 746 k 2024-05-09T07:52:12.238 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 127 k 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 162 k 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 321 k 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 298 k 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 99 k 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 85 k 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.1 M 2024-05-09T07:52:12.239 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 171 k 2024-05-09T07:52:12.240 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T07:52:12.240 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-05-09T07:52:12.240 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T07:52:12.240 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T07:52:12.240 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T07:52:12.240 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T07:52:12.240 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.4 M 2024-05-09T07:52:12.240 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.1 M 2024-05-09T07:52:12.241 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T07:52:12.242 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T07:52:12.242 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-05-09T07:52:12.242 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T07:52:12.242 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T07:52:12.242 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T07:52:12.242 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 21 M 2024-05-09T07:52:12.242 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 32 k 2024-05-09T07:52:12.242 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 2.4 M 2024-05-09T07:52:12.242 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 249 k 2024-05-09T07:52:12.243 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 4.7 M 2024-05-09T07:52:12.243 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 17 M 2024-05-09T07:52:12.243 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 16 k 2024-05-09T07:52:12.243 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 25 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 163 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T07:52:12.244 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 500 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 5.3 M 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T07:52:12.245 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 45 k 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 135 k 2024-05-09T07:52:12.246 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T07:52:12.247 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T07:52:12.248 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T07:52:12.249 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T07:52:12.250 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:52:12.251 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-05-09T07:52:12.252 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-05-09T07:52:12.252 INFO:teuthology.orchestra.run.smithi110.stdout:Install 148 Packages 2024-05-09T07:52:12.252 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 8 Packages 2024-05-09T07:52:12.252 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:52:12.252 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 225 M 2024-05-09T07:52:12.252 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-05-09T07:52:12.581 INFO:teuthology.orchestra.run.smithi087.stdout:(66/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2024-05-09T07:52:12.676 INFO:teuthology.orchestra.run.smithi087.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 5.7 MB/s | 4.7 MB 00:00 2024-05-09T07:52:13.146 INFO:teuthology.orchestra.run.smithi110.stdout:(1/156): ceph-19.0.0-2515.g96805dcf.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-05-09T07:52:13.166 INFO:teuthology.orchestra.run.smithi087.stdout:(68/156): ceph-test-19.0.0-2515.g96805dcf.el9.x 6.9 MB/s | 48 MB 00:06 2024-05-09T07:52:13.208 INFO:teuthology.orchestra.run.smithi087.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 1.7 MB/s | 911 kB 00:00 2024-05-09T07:52:13.250 INFO:teuthology.orchestra.run.smithi087.stdout:(70/156): postgresql-13.14-1.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2024-05-09T07:52:13.350 INFO:teuthology.orchestra.run.smithi087.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 726 kB/s | 133 kB 00:00 2024-05-09T07:52:13.408 INFO:teuthology.orchestra.run.smithi087.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-09T07:52:13.467 INFO:teuthology.orchestra.run.smithi087.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-05-09T07:52:13.550 INFO:teuthology.orchestra.run.smithi087.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-09T07:52:13.634 INFO:teuthology.orchestra.run.smithi087.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-05-09T07:52:13.693 INFO:teuthology.orchestra.run.smithi087.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-05-09T07:52:13.746 INFO:teuthology.orchestra.run.smithi110.stdout:(2/156): ceph-fuse-19.0.0-2515.g96805dcf.el9.x8 1.4 MB/s | 889 kB 00:00 2024-05-09T07:52:13.751 INFO:teuthology.orchestra.run.smithi087.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-05-09T07:52:13.810 INFO:teuthology.orchestra.run.smithi087.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-09T07:52:13.838 INFO:teuthology.orchestra.run.smithi110.stdout:(3/156): ceph-immutable-object-cache-19.0.0-251 1.5 MB/s | 145 kB 00:00 2024-05-09T07:52:13.860 INFO:teuthology.orchestra.run.smithi087.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-05-09T07:52:14.311 INFO:teuthology.orchestra.run.smithi087.stdout:(80/156): postgresql-server-13.14-1.el9.x86_64. 5.2 MB/s | 5.8 MB 00:01 2024-05-09T07:52:14.394 INFO:teuthology.orchestra.run.smithi087.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-05-09T07:52:14.486 INFO:teuthology.orchestra.run.smithi087.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-05-09T07:52:14.545 INFO:teuthology.orchestra.run.smithi087.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-09T07:52:14.595 INFO:teuthology.orchestra.run.smithi087.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-05-09T07:52:14.679 INFO:teuthology.orchestra.run.smithi087.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-05-09T07:52:14.746 INFO:teuthology.orchestra.run.smithi087.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.8 MB/s | 5.1 MB 00:00 2024-05-09T07:52:14.771 INFO:teuthology.orchestra.run.smithi087.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-05-09T07:52:14.846 INFO:teuthology.orchestra.run.smithi087.stdout:(88/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.1 MB/s | 6.0 MB 00:01 2024-05-09T07:52:14.863 INFO:teuthology.orchestra.run.smithi087.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-05-09T07:52:14.880 INFO:teuthology.orchestra.run.smithi110.stdout:(4/156): ceph-mds-19.0.0-2515.g96805dcf.el9.x86 2.3 MB/s | 2.4 MB 00:01 2024-05-09T07:52:14.888 INFO:teuthology.orchestra.run.smithi087.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-05-09T07:52:14.931 INFO:teuthology.orchestra.run.smithi087.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 997 kB/s | 42 kB 00:00 2024-05-09T07:52:14.981 INFO:teuthology.orchestra.run.smithi087.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-05-09T07:52:15.006 INFO:teuthology.orchestra.run.smithi087.stdout:(93/156): python3-requests-oauthlib-1.3.0-12.el 336 kB/s | 54 kB 00:00 2024-05-09T07:52:15.040 INFO:teuthology.orchestra.run.smithi087.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-09T07:52:15.057 INFO:teuthology.orchestra.run.smithi087.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-05-09T07:52:15.091 INFO:teuthology.orchestra.run.smithi087.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-05-09T07:52:15.218 INFO:teuthology.orchestra.run.smithi087.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 456 kB/s | 58 kB 00:00 2024-05-09T07:52:15.250 INFO:teuthology.orchestra.run.smithi087.stdout:(98/156): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-05-09T07:52:15.275 INFO:teuthology.orchestra.run.smithi087.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-09T07:52:15.308 INFO:teuthology.orchestra.run.smithi087.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-09T07:52:15.334 INFO:teuthology.orchestra.run.smithi087.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-05-09T07:52:15.426 INFO:teuthology.orchestra.run.smithi087.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-05-09T07:52:15.526 INFO:teuthology.orchestra.run.smithi087.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-05-09T07:52:15.547 INFO:teuthology.orchestra.run.smithi110.stdout:(5/156): ceph-base-19.0.0-2515.g96805dcf.el9.x8 2.0 MB/s | 5.4 MB 00:02 2024-05-09T07:52:15.676 INFO:teuthology.orchestra.run.smithi087.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-05-09T07:52:15.727 INFO:teuthology.orchestra.run.smithi087.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-05-09T07:52:15.760 INFO:teuthology.orchestra.run.smithi087.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-05-09T07:52:15.789 INFO:teuthology.orchestra.run.smithi110.stdout:(6/156): ceph-mgr-19.0.0-2515.g96805dcf.el9.x86 1.6 MB/s | 1.5 MB 00:00 2024-05-09T07:52:15.810 INFO:teuthology.orchestra.run.smithi087.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 523 kB/s | 26 kB 00:00 2024-05-09T07:52:15.870 INFO:teuthology.orchestra.run.smithi087.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 827 kB/s | 49 kB 00:00 2024-05-09T07:52:15.937 INFO:teuthology.orchestra.run.smithi087.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-05-09T07:52:15.962 INFO:teuthology.orchestra.run.smithi087.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 733 kB/s | 67 kB 00:00 2024-05-09T07:52:15.995 INFO:teuthology.orchestra.run.smithi087.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-09T07:52:16.054 INFO:teuthology.orchestra.run.smithi087.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-05-09T07:52:16.088 INFO:teuthology.orchestra.run.smithi087.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-05-09T07:52:16.113 INFO:teuthology.orchestra.run.smithi087.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 740 kB/s | 43 kB 00:00 2024-05-09T07:52:16.146 INFO:teuthology.orchestra.run.smithi087.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-05-09T07:52:16.244 INFO:teuthology.orchestra.run.smithi087.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 114 kB/s | 15 kB 00:00 2024-05-09T07:52:16.297 INFO:teuthology.orchestra.run.smithi087.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2024-05-09T07:52:16.322 INFO:teuthology.orchestra.run.smithi087.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 4.5 MB/s | 358 kB 00:00 2024-05-09T07:52:16.356 INFO:teuthology.orchestra.run.smithi087.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-05-09T07:52:16.381 INFO:teuthology.orchestra.run.smithi087.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 601 kB/s | 35 kB 00:00 2024-05-09T07:52:16.415 INFO:teuthology.orchestra.run.smithi087.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-05-09T07:52:16.465 INFO:teuthology.orchestra.run.smithi087.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-05-09T07:52:16.516 INFO:teuthology.orchestra.run.smithi087.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-05-09T07:52:16.532 INFO:teuthology.orchestra.run.smithi087.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-05-09T07:52:16.558 INFO:teuthology.orchestra.run.smithi087.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-05-09T07:52:16.575 INFO:teuthology.orchestra.run.smithi087.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 552 kB/s | 23 kB 00:00 2024-05-09T07:52:16.600 INFO:teuthology.orchestra.run.smithi087.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 464 kB/s | 19 kB 00:00 2024-05-09T07:52:16.617 INFO:teuthology.orchestra.run.smithi087.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 468 kB/s | 20 kB 00:00 2024-05-09T07:52:16.667 INFO:teuthology.orchestra.run.smithi087.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-05-09T07:52:16.684 INFO:teuthology.orchestra.run.smithi087.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-05-09T07:52:16.718 INFO:teuthology.orchestra.run.smithi087.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-09T07:52:16.743 INFO:teuthology.orchestra.run.smithi087.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 983 kB/s | 58 kB 00:00 2024-05-09T07:52:16.777 INFO:teuthology.orchestra.run.smithi087.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-05-09T07:52:16.810 INFO:teuthology.orchestra.run.smithi087.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-05-09T07:52:16.836 INFO:teuthology.orchestra.run.smithi087.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-09T07:52:16.861 INFO:teuthology.orchestra.run.smithi087.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 557 kB/s | 28 kB 00:00 2024-05-09T07:52:16.886 INFO:teuthology.orchestra.run.smithi087.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 606 kB/s | 31 kB 00:00 2024-05-09T07:52:16.912 INFO:teuthology.orchestra.run.smithi087.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-05-09T07:52:16.937 INFO:teuthology.orchestra.run.smithi087.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-05-09T07:52:16.962 INFO:teuthology.orchestra.run.smithi087.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-05-09T07:52:16.988 INFO:teuthology.orchestra.run.smithi087.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-09T07:52:17.022 INFO:teuthology.orchestra.run.smithi087.stdout:(142/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-05-09T07:52:17.047 INFO:teuthology.orchestra.run.smithi087.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-05-09T07:52:17.089 INFO:teuthology.orchestra.run.smithi087.stdout:(144/156): python3-werkzeug-2.0.3-3.el9.1.noarc 6.2 MB/s | 427 kB 00:00 2024-05-09T07:52:17.114 INFO:teuthology.orchestra.run.smithi087.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-05-09T07:52:17.148 INFO:teuthology.orchestra.run.smithi087.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-05-09T07:52:17.190 INFO:teuthology.orchestra.run.smithi087.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-05-09T07:52:17.414 INFO:teuthology.orchestra.run.smithi110.stdout:(7/156): ceph-mon-19.0.0-2515.g96805dcf.el9.x86 2.5 MB/s | 4.7 MB 00:01 2024-05-09T07:52:17.857 INFO:teuthology.orchestra.run.smithi087.stdout:(148/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.4 MB/s | 16 MB 00:02 2024-05-09T07:52:18.115 INFO:teuthology.orchestra.run.smithi087.stdout:(149/156): librbd1-19.0.0-2515.g96805dcf.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-05-09T07:52:18.191 INFO:teuthology.orchestra.run.smithi087.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 6.9 MB/s | 2.3 MB 00:00 2024-05-09T07:52:18.249 INFO:teuthology.orchestra.run.smithi087.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 717 kB/s | 42 kB 00:00 2024-05-09T07:52:18.333 INFO:teuthology.orchestra.run.smithi087.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.9 MB/s | 248 kB 00:00 2024-05-09T07:52:18.433 INFO:teuthology.orchestra.run.smithi087.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 5.8 MB/s | 1.8 MB 00:00 2024-05-09T07:52:18.533 INFO:teuthology.orchestra.run.smithi087.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 6.7 MB/s | 1.3 MB 00:00 2024-05-09T07:52:18.717 INFO:teuthology.orchestra.run.smithi087.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 8.4 MB/s | 2.4 MB 00:00 2024-05-09T07:52:19.733 INFO:teuthology.orchestra.run.smithi087.stdout:(156/156): librados2-19.0.0-2515.g96805dcf.el9. 1.3 MB/s | 3.4 MB 00:02 2024-05-09T07:52:19.736 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-05-09T07:52:19.736 INFO:teuthology.orchestra.run.smithi087.stdout:Total 14 MB/s | 225 MB 00:16 2024-05-09T07:52:20.958 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-05-09T07:52:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-05-09T07:52:21.108 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-05-09T07:52:23.278 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-05-09T07:52:23.278 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-05-09T07:52:24.122 INFO:teuthology.orchestra.run.smithi110.stdout:(8/156): ceph-radosgw-19.0.0-2515.g96805dcf.el9 1.5 MB/s | 10 MB 00:06 2024-05-09T07:52:24.222 INFO:teuthology.orchestra.run.smithi110.stdout:(9/156): ceph-selinux-19.0.0-2515.g96805dcf.el9 252 kB/s | 25 kB 00:00 2024-05-09T07:52:26.639 INFO:teuthology.orchestra.run.smithi110.stdout:(10/156): ceph-osd-19.0.0-2515.g96805dcf.el9.x8 1.5 MB/s | 17 MB 00:10 2024-05-09T07:52:26.797 INFO:teuthology.orchestra.run.smithi110.stdout:(11/156): cephfs-mirror-19.0.0-2515.g96805dcf.e 1.4 MB/s | 222 kB 00:00 2024-05-09T07:52:26.881 INFO:teuthology.orchestra.run.smithi110.stdout:(12/156): cephfs-shell-19.0.0-2515.g96805dcf.el 324 kB/s | 27 kB 00:00 2024-05-09T07:52:26.956 INFO:teuthology.orchestra.run.smithi110.stdout:(13/156): libcephfs-devel-19.0.0-2515.g96805dcf 423 kB/s | 32 kB 00:00 2024-05-09T07:52:27.373 INFO:teuthology.orchestra.run.smithi110.stdout:(14/156): libcephfs2-19.0.0-2515.g96805dcf.el9. 1.7 MB/s | 746 kB 00:00 2024-05-09T07:52:27.523 INFO:teuthology.orchestra.run.smithi110.stdout:(15/156): libcephsqlite-19.0.0-2515.g96805dcf.e 1.1 MB/s | 163 kB 00:00 2024-05-09T07:52:27.641 INFO:teuthology.orchestra.run.smithi110.stdout:(16/156): librados-devel-19.0.0-2515.g96805dcf. 1.1 MB/s | 127 kB 00:00 2024-05-09T07:52:28.050 INFO:teuthology.orchestra.run.smithi110.stdout:(17/156): ceph-common-19.0.0-2515.g96805dcf.el9 1.4 MB/s | 21 MB 00:15 2024-05-09T07:52:28.075 INFO:teuthology.orchestra.run.smithi110.stdout:(18/156): libradosstriper1-19.0.0-2515.g96805dc 1.1 MB/s | 500 kB 00:00 2024-05-09T07:52:28.158 INFO:teuthology.orchestra.run.smithi110.stdout:(19/156): python3-ceph-argparse-19.0.0-2515.g96 541 kB/s | 45 kB 00:00 2024-05-09T07:52:28.259 INFO:teuthology.orchestra.run.smithi110.stdout:(20/156): python3-ceph-common-19.0.0-2515.g9680 1.3 MB/s | 135 kB 00:00 2024-05-09T07:52:28.351 INFO:teuthology.orchestra.run.smithi110.stdout:(21/156): python3-cephfs-19.0.0-2515.g96805dcf. 1.7 MB/s | 162 kB 00:00 2024-05-09T07:52:28.493 INFO:teuthology.orchestra.run.smithi110.stdout:(22/156): python3-rados-19.0.0-2515.g96805dcf.e 2.2 MB/s | 321 kB 00:00 2024-05-09T07:52:28.735 INFO:teuthology.orchestra.run.smithi110.stdout:(23/156): python3-rbd-19.0.0-2515.g96805dcf.el9 1.2 MB/s | 298 kB 00:00 2024-05-09T07:52:28.793 INFO:teuthology.orchestra.run.smithi110.stdout:(24/156): python3-rgw-19.0.0-2515.g96805dcf.el9 1.7 MB/s | 99 kB 00:00 2024-05-09T07:52:28.862 INFO:teuthology.orchestra.run.smithi110.stdout:(25/156): rbd-fuse-19.0.0-2515.g96805dcf.el9.x8 1.3 MB/s | 85 kB 00:00 2024-05-09T07:52:29.403 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-05-09T07:52:29.482 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T07:52:29.518 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T07:52:29.576 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T07:52:29.614 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T07:52:29.639 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T07:52:29.661 INFO:teuthology.orchestra.run.smithi110.stdout:(26/156): rbd-mirror-19.0.0-2515.g96805dcf.el9. 3.9 MB/s | 3.1 MB 00:00 2024-05-09T07:52:29.692 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T07:52:29.727 INFO:teuthology.orchestra.run.smithi110.stdout:(27/156): rbd-nbd-19.0.0-2515.g96805dcf.el9.x86 2.5 MB/s | 171 kB 00:00 2024-05-09T07:52:29.778 INFO:teuthology.orchestra.run.smithi110.stdout:(28/156): ceph-grafana-dashboards-19.0.0-2515.g 636 kB/s | 32 kB 00:00 2024-05-09T07:52:29.845 INFO:teuthology.orchestra.run.smithi110.stdout:(29/156): ceph-mgr-cephadm-19.0.0-2515.g96805dc 2.1 MB/s | 142 kB 00:00 2024-05-09T07:52:30.062 INFO:teuthology.orchestra.run.smithi110.stdout:(30/156): librgw2-19.0.0-2515.g96805dcf.el9.x86 2.6 MB/s | 5.3 MB 00:02 2024-05-09T07:52:30.081 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T07:52:30.124 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 8/164 2024-05-09T07:52:30.235 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 8/164 2024-05-09T07:52:30.266 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 9/164 2024-05-09T07:52:30.349 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 9/164 2024-05-09T07:52:30.379 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 10/164 2024-05-09T07:52:30.548 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T07:52:30.611 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T07:52:30.637 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 13/164 2024-05-09T07:52:30.637 INFO:teuthology.orchestra.run.smithi110.stdout:(31/156): ceph-mgr-dashboard-19.0.0-2515.g96805 4.4 MB/s | 3.5 MB 00:00 2024-05-09T07:52:30.741 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 13/164 2024-05-09T07:52:30.754 INFO:teuthology.orchestra.run.smithi110.stdout:(32/156): ceph-mgr-modules-core-19.0.0-2515.g96 2.1 MB/s | 249 kB 00:00 2024-05-09T07:52:30.763 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86 14/164 2024-05-09T07:52:30.821 INFO:teuthology.orchestra.run.smithi110.stdout:(33/156): ceph-mgr-rook-19.0.0-2515.g96805dcf.e 740 kB/s | 49 kB 00:00 2024-05-09T07:52:30.826 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86 14/164 2024-05-09T07:52:30.848 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T07:52:30.874 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T07:52:30.888 INFO:teuthology.orchestra.run.smithi110.stdout:(34/156): ceph-prometheus-alerts-19.0.0-2515.g9 246 kB/s | 16 kB 00:00 2024-05-09T07:52:31.021 INFO:teuthology.orchestra.run.smithi110.stdout:(35/156): ceph-volume-19.0.0-2515.g96805dcf.el9 1.9 MB/s | 264 kB 00:00 2024-05-09T07:52:31.074 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T07:52:31.254 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T07:52:31.263 INFO:teuthology.orchestra.run.smithi110.stdout:(36/156): cephadm-19.0.0-2515.g96805dcf.el9.noa 3.1 MB/s | 763 kB 00:00 2024-05-09T07:52:31.314 INFO:teuthology.orchestra.run.smithi110.stdout:(37/156): cephfs-top-19.0.0-2515.g96805dcf.el9. 366 kB/s | 18 kB 00:00 2024-05-09T07:52:31.373 INFO:teuthology.orchestra.run.smithi110.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-05-09T07:52:31.420 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T07:52:31.472 INFO:teuthology.orchestra.run.smithi110.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 7.9 MB/s | 803 kB 00:00 2024-05-09T07:52:31.480 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T07:52:31.548 INFO:teuthology.orchestra.run.smithi110.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-05-09T07:52:31.597 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T07:52:31.632 INFO:teuthology.orchestra.run.smithi110.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-05-09T07:52:31.698 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T07:52:31.742 INFO:teuthology.orchestra.run.smithi110.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-05-09T07:52:31.808 INFO:teuthology.orchestra.run.smithi110.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-09T07:52:31.874 INFO:teuthology.orchestra.run.smithi110.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-09T07:52:31.926 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T07:52:31.967 INFO:teuthology.orchestra.run.smithi110.stdout:(45/156): ceph-mgr-diskprediction-local-19.0.0- 3.9 MB/s | 7.4 MB 00:01 2024-05-09T07:52:32.025 INFO:teuthology.orchestra.run.smithi110.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 831 kB/s | 125 kB 00:00 2024-05-09T07:52:32.038 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T07:52:32.058 INFO:teuthology.orchestra.run.smithi110.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-05-09T07:52:32.131 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T07:52:32.134 INFO:teuthology.orchestra.run.smithi110.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 6.2 MB/s | 689 kB 00:00 2024-05-09T07:52:32.167 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-09T07:52:32.176 INFO:teuthology.orchestra.run.smithi110.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 7.9 MB/s | 943 kB 00:00 2024-05-09T07:52:32.205 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-09T07:52:32.218 INFO:teuthology.orchestra.run.smithi110.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-05-09T07:52:32.243 INFO:teuthology.orchestra.run.smithi110.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 321 kB/s | 21 kB 00:00 2024-05-09T07:52:32.287 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-09T07:52:32.293 INFO:teuthology.orchestra.run.smithi110.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-05-09T07:52:32.321 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-09T07:52:32.327 INFO:teuthology.orchestra.run.smithi110.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-05-09T07:52:32.364 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-09T07:52:32.377 INFO:teuthology.orchestra.run.smithi110.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-05-09T07:52:32.397 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-09T07:52:32.425 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-09T07:52:32.436 INFO:teuthology.orchestra.run.smithi110.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 192 kB/s | 11 kB 00:00 2024-05-09T07:52:32.494 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-09T07:52:32.503 INFO:teuthology.orchestra.run.smithi110.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-05-09T07:52:32.545 INFO:teuthology.orchestra.run.smithi110.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-09T07:52:32.546 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-09T07:52:32.570 INFO:teuthology.orchestra.run.smithi110.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 677 kB/s | 45 kB 00:00 2024-05-09T07:52:32.577 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-09T07:52:32.621 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-09T07:52:32.654 INFO:teuthology.orchestra.run.smithi110.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-05-09T07:52:32.679 INFO:teuthology.orchestra.run.smithi110.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 582 kB 00:00 2024-05-09T07:52:32.697 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-09T07:52:32.731 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:19.0.0-2515.g96805dcf.el9. 33/164 2024-05-09T07:52:32.780 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el 34/164 2024-05-09T07:52:32.780 INFO:teuthology.orchestra.run.smithi110.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-05-09T07:52:32.804 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_6 35/164 2024-05-09T07:52:32.805 INFO:teuthology.orchestra.run.smithi110.stdout:(62/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 169 kB/s | 25 kB 00:00 2024-05-09T07:52:32.872 INFO:teuthology.orchestra.run.smithi110.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-09T07:52:32.872 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-09T07:52:32.897 INFO:teuthology.orchestra.run.smithi110.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-09T07:52:32.918 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-09T07:52:32.939 INFO:teuthology.orchestra.run.smithi110.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-05-09T07:52:32.993 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-09T07:52:33.125 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-09T07:52:33.131 INFO:teuthology.orchestra.run.smithi110.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-05-09T07:52:33.179 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-09T07:52:33.206 INFO:teuthology.orchestra.run.smithi110.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-05-09T07:52:33.324 INFO:teuthology.orchestra.run.smithi110.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-05-09T07:52:33.399 INFO:teuthology.orchestra.run.smithi110.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 4.6 MB/s | 911 kB 00:00 2024-05-09T07:52:33.424 INFO:teuthology.orchestra.run.smithi110.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-05-09T07:52:33.549 INFO:teuthology.orchestra.run.smithi110.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-05-09T07:52:33.616 INFO:teuthology.orchestra.run.smithi110.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-09T07:52:33.700 INFO:teuthology.orchestra.run.smithi110.stdout:(73/156): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-05-09T07:52:33.702 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-09T07:52:33.783 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-09T07:52:33.812 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-09T07:52:33.856 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-09T07:52:33.893 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_6 45/164 2024-05-09T07:52:33.909 INFO:teuthology.orchestra.run.smithi110.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-05-09T07:52:33.936 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-09T07:52:34.068 INFO:teuthology.orchestra.run.smithi110.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-05-09T07:52:34.090 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-09T07:52:34.093 INFO:teuthology.orchestra.run.smithi110.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-05-09T07:52:34.135 INFO:teuthology.orchestra.run.smithi110.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-05-09T07:52:34.154 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-09T07:52:34.160 INFO:teuthology.orchestra.run.smithi110.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-05-09T07:52:34.208 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-09T07:52:34.210 INFO:teuthology.orchestra.run.smithi110.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-05-09T07:52:34.252 INFO:teuthology.orchestra.run.smithi110.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-05-09T07:52:34.281 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T07:52:34.313 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T07:52:34.336 INFO:teuthology.orchestra.run.smithi110.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-05-09T07:52:34.349 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T07:52:34.395 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T07:52:34.420 INFO:teuthology.orchestra.run.smithi110.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-05-09T07:52:34.432 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T07:52:34.474 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T07:52:34.487 INFO:teuthology.orchestra.run.smithi110.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-05-09T07:52:34.517 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T07:52:34.570 INFO:teuthology.orchestra.run.smithi110.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-05-09T07:52:34.595 INFO:teuthology.orchestra.run.smithi110.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-05-09T07:52:34.652 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T07:52:34.663 INFO:teuthology.orchestra.run.smithi110.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-09T07:52:34.849 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T07:52:34.878 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T07:52:34.920 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T07:52:35.015 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T07:52:35.054 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T07:52:35.095 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T07:52:35.105 INFO:teuthology.orchestra.run.smithi110.stdout:(87/156): ceph-test-19.0.0-2515.g96805dcf.el9.x 4.4 MB/s | 48 MB 00:10 2024-05-09T07:52:35.127 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T07:52:35.131 INFO:teuthology.orchestra.run.smithi110.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 481 kB/s | 269 kB 00:00 2024-05-09T07:52:35.152 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T07:52:35.180 INFO:teuthology.orchestra.run.smithi110.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 681 kB/s | 51 kB 00:00 2024-05-09T07:52:35.205 INFO:teuthology.orchestra.run.smithi110.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 715 kB/s | 54 kB 00:00 2024-05-09T07:52:35.231 INFO:teuthology.orchestra.run.smithi110.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 491 kB/s | 279 kB 00:00 2024-05-09T07:52:35.252 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T07:52:35.281 INFO:teuthology.orchestra.run.smithi110.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-05-09T07:52:35.315 INFO:teuthology.orchestra.run.smithi110.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 529 kB/s | 44 kB 00:00 2024-05-09T07:52:35.385 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T07:52:35.398 INFO:teuthology.orchestra.run.smithi110.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 430 kB/s | 36 kB 00:00 2024-05-09T07:52:35.432 INFO:teuthology.orchestra.run.smithi110.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-05-09T07:52:35.434 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T07:52:35.462 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T07:52:35.482 INFO:teuthology.orchestra.run.smithi110.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-05-09T07:52:35.497 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T07:52:35.533 INFO:teuthology.orchestra.run.smithi110.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-05-09T07:52:35.535 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T07:52:35.567 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T07:52:35.575 INFO:teuthology.orchestra.run.smithi110.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 629 kB/s | 58 kB 00:00 2024-05-09T07:52:35.597 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T07:52:35.625 INFO:teuthology.orchestra.run.smithi110.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-05-09T07:52:35.631 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T07:52:35.650 INFO:teuthology.orchestra.run.smithi110.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-05-09T07:52:35.665 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T07:52:35.706 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T07:52:35.709 INFO:teuthology.orchestra.run.smithi110.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 536 kB/s | 45 kB 00:00 2024-05-09T07:52:35.741 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T07:52:35.826 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T07:52:35.871 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T07:52:35.901 INFO:teuthology.orchestra.run.smithi110.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-05-09T07:52:35.902 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T07:52:35.918 INFO:teuthology.orchestra.run.smithi110.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-05-09T07:52:35.949 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T07:52:36.047 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T07:52:36.095 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T07:52:36.127 INFO:teuthology.orchestra.run.smithi110.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-05-09T07:52:36.152 INFO:teuthology.orchestra.run.smithi110.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-05-09T07:52:36.169 INFO:teuthology.orchestra.run.smithi110.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 464 kB/s | 19 kB 00:00 2024-05-09T07:52:36.211 INFO:teuthology.orchestra.run.smithi110.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-05-09T07:52:36.261 INFO:teuthology.orchestra.run.smithi110.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 974 kB/s | 49 kB 00:00 2024-05-09T07:52:36.336 INFO:teuthology.orchestra.run.smithi110.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-05-09T07:52:36.362 INFO:teuthology.orchestra.run.smithi110.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 670 kB/s | 67 kB 00:00 2024-05-09T07:52:36.387 INFO:teuthology.orchestra.run.smithi110.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-05-09T07:52:36.446 INFO:teuthology.orchestra.run.smithi110.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-05-09T07:52:36.471 INFO:teuthology.orchestra.run.smithi110.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-05-09T07:52:36.496 INFO:teuthology.orchestra.run.smithi110.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 863 kB/s | 43 kB 00:00 2024-05-09T07:52:36.521 INFO:teuthology.orchestra.run.smithi110.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-05-09T07:52:36.547 INFO:teuthology.orchestra.run.smithi110.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 297 kB/s | 15 kB 00:00 2024-05-09T07:52:36.572 INFO:teuthology.orchestra.run.smithi110.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-05-09T07:52:36.606 INFO:teuthology.orchestra.run.smithi110.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-05-09T07:52:36.639 INFO:teuthology.orchestra.run.smithi110.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-05-09T07:52:36.664 INFO:teuthology.orchestra.run.smithi110.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 603 kB/s | 35 kB 00:00 2024-05-09T07:52:36.690 INFO:teuthology.orchestra.run.smithi110.stdout:(121/156): protobuf-compiler-3.14.0-13.el9.x86_ 880 kB/s | 863 kB 00:00 2024-05-09T07:52:36.715 INFO:teuthology.orchestra.run.smithi110.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-09T07:52:36.799 INFO:teuthology.orchestra.run.smithi110.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-05-09T07:52:36.821 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T07:52:36.824 INFO:teuthology.orchestra.run.smithi110.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 126 kB/s | 11 kB 00:00 2024-05-09T07:52:36.858 INFO:teuthology.orchestra.run.smithi110.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 307 kB/s | 18 kB 00:00 2024-05-09T07:52:36.867 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T07:52:36.892 INFO:teuthology.orchestra.run.smithi110.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 346 kB/s | 23 kB 00:00 2024-05-09T07:52:36.910 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T07:52:36.917 INFO:teuthology.orchestra.run.smithi110.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2024-05-09T07:52:36.950 INFO:teuthology.orchestra.run.smithi110.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-05-09T07:52:37.008 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T07:52:37.009 INFO:teuthology.orchestra.run.smithi110.stdout:(129/156): python3-grpcio-tools-1.46.7-10.el9.x 453 kB/s | 144 kB 00:00 2024-05-09T07:52:37.034 INFO:teuthology.orchestra.run.smithi110.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 552 kB/s | 46 kB 00:00 2024-05-09T07:52:37.059 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T07:52:37.067 INFO:teuthology.orchestra.run.smithi110.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-05-09T07:52:37.093 INFO:teuthology.orchestra.run.smithi110.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2024-05-09T07:52:37.118 INFO:teuthology.orchestra.run.smithi110.stdout:(133/156): python3-more-itertools-8.12.0-2.el9. 722 kB/s | 79 kB 00:00 2024-05-09T07:52:37.144 INFO:teuthology.orchestra.run.smithi110.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-05-09T07:52:37.147 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T07:52:37.169 INFO:teuthology.orchestra.run.smithi110.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-05-09T07:52:37.178 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T07:52:37.203 INFO:teuthology.orchestra.run.smithi110.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-05-09T07:52:37.228 INFO:teuthology.orchestra.run.smithi110.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 823 kB/s | 90 kB 00:00 2024-05-09T07:52:37.245 INFO:teuthology.orchestra.run.smithi110.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-05-09T07:52:37.270 INFO:teuthology.orchestra.run.smithi110.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-05-09T07:52:37.304 INFO:teuthology.orchestra.run.smithi110.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-09T07:52:37.329 INFO:teuthology.orchestra.run.smithi110.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2024-05-09T07:52:37.348 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T07:52:37.354 INFO:teuthology.orchestra.run.smithi110.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 606 kB/s | 51 kB 00:00 2024-05-09T07:52:37.379 INFO:teuthology.orchestra.run.smithi110.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-09T07:52:37.384 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T07:52:37.430 INFO:teuthology.orchestra.run.smithi110.stdout:(144/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-05-09T07:52:37.447 INFO:teuthology.orchestra.run.smithi110.stdout:(145/156): python3-websocket-client-1.2.3-2.el9 762 kB/s | 90 kB 00:00 2024-05-09T07:52:37.462 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T07:52:37.463 INFO:teuthology.orchestra.run.smithi110.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-05-09T07:52:37.489 INFO:teuthology.orchestra.run.smithi110.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-05-09T07:52:37.556 INFO:teuthology.orchestra.run.smithi110.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-05-09T07:52:37.689 INFO:teuthology.orchestra.run.smithi110.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 17 MB/s | 2.3 MB 00:00 2024-05-09T07:52:37.806 INFO:teuthology.orchestra.run.smithi110.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 16 MB/s | 1.8 MB 00:00 2024-05-09T07:52:37.915 INFO:teuthology.orchestra.run.smithi110.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 385 kB/s | 42 kB 00:00 2024-05-09T07:52:37.991 INFO:teuthology.orchestra.run.smithi110.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 3.2 MB/s | 248 kB 00:00 2024-05-09T07:52:38.091 INFO:teuthology.orchestra.run.smithi110.stdout:(153/156): librbd1-19.0.0-2515.g96805dcf.el9.x8 5.2 MB/s | 3.1 MB 00:00 2024-05-09T07:52:38.112 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T07:52:38.166 INFO:teuthology.orchestra.run.smithi110.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 7.7 MB/s | 1.3 MB 00:00 2024-05-09T07:52:38.216 INFO:teuthology.orchestra.run.smithi110.stdout:(155/156): librados2-19.0.0-2515.g96805dcf.el9. 4.5 MB/s | 3.4 MB 00:00 2024-05-09T07:52:38.232 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T07:52:38.325 INFO:teuthology.orchestra.run.smithi110.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-05-09T07:52:38.330 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-05-09T07:52:38.330 INFO:teuthology.orchestra.run.smithi110.stdout:Total 8.6 MB/s | 225 MB 00:26 2024-05-09T07:52:39.483 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T07:52:39.555 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T07:52:39.583 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T07:52:39.608 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-05-09T07:52:39.616 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T07:52:39.760 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-05-09T07:52:39.760 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-05-09T07:52:39.939 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T07:52:39.979 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 101/164 2024-05-09T07:52:40.069 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 101/164 2024-05-09T07:52:40.101 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 102/164 2024-05-09T07:52:40.137 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T07:52:40.607 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T07:52:40.633 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 105/164 2024-05-09T07:52:40.703 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 105/164 2024-05-09T07:52:40.726 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 106/164 2024-05-09T07:52:41.897 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-05-09T07:52:41.897 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-05-09T07:52:43.040 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 107/164 2024-05-09T07:52:43.082 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 107/164 2024-05-09T07:52:43.627 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 107/164 2024-05-09T07:52:43.669 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 108/164 2024-05-09T07:52:43.752 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 108/164 2024-05-09T07:52:43.752 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T07:52:43.753 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T07:52:43.753 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:52:43.835 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 109/164 2024-05-09T07:52:48.120 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-05-09T07:52:48.222 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T07:52:48.260 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T07:52:48.324 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T07:52:48.364 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T07:52:48.390 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T07:52:48.435 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T07:52:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T07:52:48.899 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 8/164 2024-05-09T07:52:49.021 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 8/164 2024-05-09T07:52:49.050 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 9/164 2024-05-09T07:52:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 9/164 2024-05-09T07:52:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 10/164 2024-05-09T07:52:49.363 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T07:52:49.419 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T07:52:49.446 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 13/164 2024-05-09T07:52:49.549 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 13/164 2024-05-09T07:52:49.572 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86 14/164 2024-05-09T07:52:49.627 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86 14/164 2024-05-09T07:52:49.666 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T07:52:49.694 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T07:52:49.883 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T07:52:50.061 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T07:52:50.221 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T07:52:50.281 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T07:52:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T07:52:50.466 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T07:52:50.660 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T07:52:50.781 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T07:52:50.875 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T07:52:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-09T07:52:50.957 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-09T07:52:51.030 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-09T07:52:51.073 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-09T07:52:51.116 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-09T07:52:51.149 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-09T07:52:51.176 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-09T07:52:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-09T07:52:51.298 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-09T07:52:51.330 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-09T07:52:51.365 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-09T07:52:51.440 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-09T07:52:51.484 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:19.0.0-2515.g96805dcf.el9. 33/164 2024-05-09T07:52:51.525 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el 34/164 2024-05-09T07:52:51.556 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_6 35/164 2024-05-09T07:52:51.625 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-09T07:52:51.671 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-09T07:52:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-09T07:52:51.878 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-09T07:52:51.932 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-09T07:52:52.459 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-09T07:52:52.544 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-09T07:52:52.573 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-09T07:52:52.609 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-09T07:52:52.646 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_6 45/164 2024-05-09T07:52:52.688 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-09T07:52:52.857 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-09T07:52:52.915 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-09T07:52:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-09T07:52:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T07:52:53.074 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T07:52:53.111 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T07:52:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T07:52:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T07:52:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T07:52:53.287 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T07:52:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T07:52:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T07:52:53.498 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T07:52:53.539 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T07:52:53.633 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T07:52:53.673 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T07:52:53.715 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T07:52:53.747 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T07:52:53.772 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T07:52:53.854 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T07:52:53.982 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T07:52:54.021 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T07:52:54.057 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T07:52:54.092 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T07:52:54.131 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T07:52:54.162 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T07:52:54.192 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T07:52:54.237 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T07:52:54.268 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T07:52:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T07:52:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T07:52:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T07:52:54.484 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T07:52:54.523 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T07:52:54.569 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T07:52:54.667 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T07:52:54.716 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T07:52:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 109/164 2024-05-09T07:52:55.093 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-05-09T07:52:55.093 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-05-09T07:52:55.093 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-05-09T07:52:55.093 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-05-09T07:52:55.093 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-05-09T07:52:55.093 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /root 2024-05-09T07:52:55.093 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-05-09T07:52:55.093 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:52:55.261 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 110/164 2024-05-09T07:52:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 110/164 2024-05-09T07:52:55.279 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:52:55.279 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T07:52:55.279 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:52:55.449 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T07:52:55.496 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T07:52:55.531 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T07:52:55.629 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T07:52:55.680 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T07:52:55.767 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T07:52:55.799 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T07:52:55.968 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T07:52:56.005 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T07:52:56.085 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T07:52:56.723 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T07:52:56.756 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 111/164 2024-05-09T07:52:56.782 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 111/164 2024-05-09T07:52:56.783 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:52:56.783 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T07:52:56.783 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T07:52:56.783 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T07:52:56.783 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:52:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T07:52:57.006 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 112/164 2024-05-09T07:52:57.030 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 112/164 2024-05-09T07:52:57.030 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:52:57.030 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T07:52:57.030 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T07:52:57.030 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T07:52:57.031 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:52:57.474 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 113/164 2024-05-09T07:52:57.497 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 113/164 2024-05-09T07:52:57.497 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:52:57.498 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T07:52:57.498 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T07:52:57.498 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T07:52:57.498 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:52:57.596 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T07:52:57.652 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T07:52:57.708 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T07:52:57.893 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T07:52:57.941 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T07:52:58.019 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T07:52:58.079 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T07:52:58.108 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T07:52:58.168 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T07:52:58.196 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T07:52:58.229 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T07:52:58.238 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T07:52:58.283 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T07:52:58.325 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T07:52:58.351 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T07:52:58.544 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T07:52:58.584 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 101/164 2024-05-09T07:52:58.674 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 101/164 2024-05-09T07:52:58.705 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 102/164 2024-05-09T07:52:58.741 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T07:52:58.742 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 125/164 2024-05-09T07:52:58.774 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 125/164 2024-05-09T07:52:58.806 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.e 126/164 2024-05-09T07:52:58.868 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf. 127/164 2024-05-09T07:52:58.898 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noa 128/164 2024-05-09T07:52:59.214 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T07:52:59.245 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 105/164 2024-05-09T07:52:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 105/164 2024-05-09T07:52:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 106/164 2024-05-09T07:52:59.928 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noa 128/164 2024-05-09T07:52:59.958 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.n 129/164 2024-05-09T07:53:00.923 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.n 129/164 2024-05-09T07:53:00.950 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2515.g968 130/164 2024-05-09T07:53:01.053 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2515.g968 130/164 2024-05-09T07:53:01.212 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el 131/164 2024-05-09T07:53:01.244 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 132/164 2024-05-09T07:53:01.268 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 132/164 2024-05-09T07:53:01.268 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:01.268 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T07:53:01.268 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T07:53:01.268 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T07:53:01.268 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:01.319 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 133/164 2024-05-09T07:53:01.331 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 133/164 2024-05-09T07:53:01.427 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 134/164 2024-05-09T07:53:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 135/164 2024-05-09T07:53:01.613 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 107/164 2024-05-09T07:53:01.652 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 107/164 2024-05-09T07:53:02.193 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 107/164 2024-05-09T07:53:02.230 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 108/164 2024-05-09T07:53:02.321 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 108/164 2024-05-09T07:53:02.321 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T07:53:02.321 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T07:53:02.321 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:02.356 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 109/164 2024-05-09T07:53:02.389 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T07:53:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 137/164 2024-05-09T07:53:02.446 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 137/164 2024-05-09T07:53:02.446 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:02.446 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T07:53:02.446 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T07:53:02.446 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T07:53:02.446 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:02.489 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2515.g96805 138/164 2024-05-09T07:53:02.512 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2515.g96805 138/164 2024-05-09T07:53:02.512 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:02.512 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T07:53:02.512 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:02.556 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 139/164 2024-05-09T07:53:02.580 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 139/164 2024-05-09T07:53:02.580 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:02.580 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T07:53:02.580 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T07:53:02.580 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T07:53:02.580 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:02.882 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 140/164 2024-05-09T07:53:02.906 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 140/164 2024-05-09T07:53:02.906 INFO:teuthology.orchestra.run.smithi087.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:02.906 INFO:teuthology.orchestra.run.smithi087.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T07:53:02.906 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T07:53:02.907 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T07:53:02.907 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:07.444 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 141/164 2024-05-09T07:53:07.485 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 142/164 2024-05-09T07:53:07.526 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 143/164 2024-05-09T07:53:07.558 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T07:53:07.594 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T07:53:07.787 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-shell-2:19.0.0-2515.g96805dcf.el9.x86_64 146/164 2024-05-09T07:53:07.832 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T07:53:07.862 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_ 148/164 2024-05-09T07:53:07.891 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T07:53:07.938 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T07:53:08.551 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T07:53:08.594 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T07:53:08.615 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T07:53:09.459 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephfs-top-2:19.0.0-2515.g96805dcf.el9.noarch 152/164 2024-05-09T07:53:09.549 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T07:53:09.598 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T07:53:09.687 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T07:53:09.718 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T07:53:09.744 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T07:53:09.745 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T07:53:09.829 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T07:53:09.862 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T07:53:09.862 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T07:53:09.946 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T07:53:09.971 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T07:53:09.977 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T07:53:09.977 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T07:53:10.157 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T07:53:10.157 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T07:53:10.241 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T07:53:10.306 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T07:53:14.003 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 109/164 2024-05-09T07:53:14.003 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-05-09T07:53:14.003 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-05-09T07:53:14.003 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-05-09T07:53:14.003 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-05-09T07:53:14.003 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-05-09T07:53:14.004 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-05-09T07:53:14.004 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-05-09T07:53:14.004 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:14.164 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 110/164 2024-05-09T07:53:14.180 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 110/164 2024-05-09T07:53:14.180 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:14.180 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T07:53:14.180 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:15.642 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 111/164 2024-05-09T07:53:15.669 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 111/164 2024-05-09T07:53:15.669 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:15.669 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T07:53:15.669 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T07:53:15.669 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T07:53:15.669 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:15.893 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 112/164 2024-05-09T07:53:15.916 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 112/164 2024-05-09T07:53:15.917 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:15.917 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T07:53:15.917 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T07:53:15.917 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T07:53:15.917 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:15.926 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T07:53:15.926 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 1/164 2024-05-09T07:53:15.926 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 2/164 2024-05-09T07:53:15.926 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 3/164 2024-05-09T07:53:15.926 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 4/164 2024-05-09T07:53:15.926 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2515.g96805 5/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 6/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 7/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 8/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 9/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 10/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 11/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 12/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 13/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-shell-2:19.0.0-2515.g96805dcf.el9.x86_64 14/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_ 15/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 16/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 17/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_6 18/164 2024-05-09T07:53:15.927 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86 19/164 2024-05-09T07:53:15.928 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 20/164 2024-05-09T07:53:15.928 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el 21/164 2024-05-09T07:53:15.928 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:19.0.0-2515.g96805dcf.el9. 22/164 2024-05-09T07:53:15.928 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_6 23/164 2024-05-09T07:53:15.928 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 24/164 2024-05-09T07:53:15.928 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 25/164 2024-05-09T07:53:15.928 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 26/164 2024-05-09T07:53:15.928 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 27/164 2024-05-09T07:53:15.928 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 28/164 2024-05-09T07:53:15.940 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 29/164 2024-05-09T07:53:15.940 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf. 30/164 2024-05-09T07:53:15.940 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noa 31/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.n 32/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2515.g968 33/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el 34/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 35/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.e 36/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 37/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 38/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephfs-top-2:19.0.0-2515.g96805dcf.el9.noarch 39/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T07:53:15.941 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T07:53:15.942 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T07:53:15.943 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T07:53:15.944 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T07:53:15.945 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T07:53:15.946 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T07:53:15.947 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T07:53:15.948 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 149/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 151/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T07:53:15.949 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T07:53:15.950 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T07:53:15.950 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T07:53:15.950 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T07:53:15.950 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T07:53:15.950 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T07:53:15.950 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T07:53:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 113/164 2024-05-09T07:53:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 113/164 2024-05-09T07:53:16.386 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:16.386 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T07:53:16.386 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T07:53:16.386 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T07:53:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:16.490 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T07:53:16.539 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T07:53:16.594 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T07:53:16.779 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T07:53:16.835 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T07:53:16.914 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T07:53:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T07:53:17.140 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T07:53:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T07:53:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T07:53:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T07:53:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 125/164 2024-05-09T07:53:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 125/164 2024-05-09T07:53:17.683 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.e 126/164 2024-05-09T07:53:17.745 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf. 127/164 2024-05-09T07:53:17.775 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noa 128/164 2024-05-09T07:53:18.591 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T07:53:18.591 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:18.591 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-05-09T07:53:18.591 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T07:53:18.591 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T07:53:18.591 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.592 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.593 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-shell-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: cephfs-top-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T07:53:18.594 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T07:53:18.595 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T07:53:18.596 INFO:teuthology.orchestra.run.smithi087.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.597 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T07:53:18.598 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T07:53:18.599 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T07:53:18.600 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T07:53:18.601 INFO:teuthology.orchestra.run.smithi087.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T07:53:18.602 INFO:teuthology.orchestra.run.smithi087.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T07:53:18.602 INFO:teuthology.orchestra.run.smithi087.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T07:53:18.602 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T07:53:18.602 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T07:53:18.602 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T07:53:18.602 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T07:53:18.602 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T07:53:18.602 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T07:53:18.603 INFO:teuthology.orchestra.run.smithi087.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T07:53:18.603 INFO:teuthology.orchestra.run.smithi087.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T07:53:18.603 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.603 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.603 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:18.603 INFO:teuthology.orchestra.run.smithi087.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T07:53:18.603 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T07:53:18.603 INFO:teuthology.orchestra.run.smithi087.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T07:53:18.603 INFO:teuthology.orchestra.run.smithi087.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T07:53:18.604 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T07:53:18.604 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T07:53:18.604 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T07:53:18.604 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:18.604 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-05-09T07:53:18.806 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noa 128/164 2024-05-09T07:53:18.843 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.n 129/164 2024-05-09T07:53:19.035 DEBUG:teuthology.parallel:result is None 2024-05-09T07:53:19.805 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.n 129/164 2024-05-09T07:53:19.835 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2515.g968 130/164 2024-05-09T07:53:19.937 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2515.g968 130/164 2024-05-09T07:53:20.091 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el 131/164 2024-05-09T07:53:20.122 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 132/164 2024-05-09T07:53:20.145 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 132/164 2024-05-09T07:53:20.145 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:20.146 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T07:53:20.146 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T07:53:20.146 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T07:53:20.146 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 133/164 2024-05-09T07:53:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 133/164 2024-05-09T07:53:20.321 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 134/164 2024-05-09T07:53:20.396 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 135/164 2024-05-09T07:53:21.285 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T07:53:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 137/164 2024-05-09T07:53:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 137/164 2024-05-09T07:53:21.339 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:21.339 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T07:53:21.339 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T07:53:21.339 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T07:53:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2515.g96805 138/164 2024-05-09T07:53:21.406 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2515.g96805 138/164 2024-05-09T07:53:21.406 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:21.406 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T07:53:21.406 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:21.450 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 139/164 2024-05-09T07:53:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 139/164 2024-05-09T07:53:21.473 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:21.473 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T07:53:21.473 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T07:53:21.474 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T07:53:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:21.775 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 140/164 2024-05-09T07:53:21.800 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 140/164 2024-05-09T07:53:21.800 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T07:53:21.800 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T07:53:21.800 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T07:53:21.800 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T07:53:21.800 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:26.329 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 141/164 2024-05-09T07:53:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 142/164 2024-05-09T07:53:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 143/164 2024-05-09T07:53:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T07:53:26.487 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T07:53:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-shell-2:19.0.0-2515.g96805dcf.el9.x86_64 146/164 2024-05-09T07:53:26.734 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T07:53:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_ 148/164 2024-05-09T07:53:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T07:53:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T07:53:27.448 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T07:53:27.487 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T07:53:27.507 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T07:53:28.351 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:19.0.0-2515.g96805dcf.el9.noarch 152/164 2024-05-09T07:53:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T07:53:28.509 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T07:53:28.606 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T07:53:28.636 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T07:53:28.662 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T07:53:28.663 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T07:53:28.747 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T07:53:28.779 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T07:53:28.780 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T07:53:28.856 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T07:53:28.882 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T07:53:28.886 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T07:53:28.886 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T07:53:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T07:53:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T07:53:29.133 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T07:53:29.206 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T07:53:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T07:53:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 1/164 2024-05-09T07:53:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 2/164 2024-05-09T07:53:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 3/164 2024-05-09T07:53:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 4/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2515.g96805 5/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 6/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 7/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 8/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 9/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 10/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 11/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 12/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 13/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-shell-2:19.0.0-2515.g96805dcf.el9.x86_64 14/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_ 15/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 16/164 2024-05-09T07:53:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 17/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_6 18/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86 19/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 20/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el 21/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:19.0.0-2515.g96805dcf.el9. 22/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_6 23/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 24/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 25/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 26/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 27/164 2024-05-09T07:53:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 28/164 2024-05-09T07:53:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 29/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf. 30/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noa 31/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.n 32/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2515.g968 33/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el 34/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 35/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.e 36/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 37/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 38/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:19.0.0-2515.g96805dcf.el9.noarch 39/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T07:53:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T07:53:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T07:53:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T07:53:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T07:53:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T07:53:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T07:53:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T07:53:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T07:53:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T07:53:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 149/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 151/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T07:53:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T07:53:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T07:53:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T07:53:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T07:53:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T07:53:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T07:53:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T07:53:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T07:53:37.279 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T07:53:37.279 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T07:53:37.280 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T07:53:37.281 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T07:53:37.281 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.281 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.281 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.281 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.282 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-09T07:53:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.284 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T07:53:37.285 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T07:53:37.286 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T07:53:37.287 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T07:53:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T07:53:37.289 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.290 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T07:53:37.291 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T07:53:37.292 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T07:53:37.293 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:37.293 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-05-09T07:53:37.743 DEBUG:teuthology.parallel:result is None 2024-05-09T07:53:37.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-09T07:53:37.884 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T07:53:37.912 INFO:teuthology.orchestra.run.smithi087.stdout:19.0.0-2515.g96805dcf.el9 2024-05-09T07:53:37.912 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2515.g96805dcf.el9 2024-05-09T07:53:37.912 INFO:teuthology.task.install:The correct ceph version 19.0.0-2515.g96805dcf is installed. 2024-05-09T07:53:37.914 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-09T07:53:38.137 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T07:53:38.161 INFO:teuthology.orchestra.run.smithi110.stdout:19.0.0-2515.g96805dcf.el9 2024-05-09T07:53:38.161 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2515.g96805dcf.el9 2024-05-09T07:53:38.161 INFO:teuthology.task.install:The correct ceph version 19.0.0-2515.g96805dcf is installed. 2024-05-09T07:53:38.163 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T07:53:38.163 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:38.163 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T07:53:38.197 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:53:38.197 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T07:53:38.230 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T07:53:38.230 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:38.230 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T07:53:38.267 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T07:53:38.336 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:53:38.336 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T07:53:38.362 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T07:53:38.428 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T07:53:38.428 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:38.428 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T07:53:38.457 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T07:53:38.526 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:53:38.526 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T07:53:38.551 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T07:53:38.616 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T07:53:38.616 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:38.616 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T07:53:38.645 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T07:53:38.713 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:53:38.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T07:53:38.738 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T07:53:38.802 INFO:teuthology.run_tasks:Running task ceph... 2024-05-09T07:53:38.904 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-09T07:53:38.904 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-05-09T07:53:38.907 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-05-09T07:53:38.932 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-09T07:53:38.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T07:53:38.975 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T07:53:39.001 INFO:tasks.ceph:Creating extra log directories... 2024-05-09T07:53:39.001 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T07:53:39.043 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T07:53:39.074 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-09T07:53:39.074 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-09T07:53:39.075 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-09T07:53:39.075 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:39.075 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T07:53:39.126 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T07:53:39.233 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T07:53:39.259 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:53:39.259 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T07:53:39.274 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T07:53:39.378 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T07:53:39.407 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-09T07:53:39.407 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-09T07:53:39.407 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636', 'branch': 'squid', 'description': 'fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_blogbench traceless/50pc}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7698636', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'be85c202969d25af6e130678e7d73a20e9c4ca11'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2334, 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc', 'sleep_before_teardown': 0, 'subset': '359/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_be85c202969d25af6e130678e7d73a20e9c4ca11/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'be85c202969d25af6e130678e7d73a20e9c4ca11', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPn7ZtjXs0xXVrD5FfDviomc40eyBdvdJM1K/sbPzAlWXuMNQ4o7EUSkR9/olHt+ten3F24LgLr3IbW9bYajNec=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJlEbrcInhO3xxuJpVhRCwm/WHXvjvEfoKY+fvHxJ3yTy8XEJcY1EXx8oAdX6c1JzePO3forA5JGB2rCpLwbrz8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'all': ['suites/blogbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_21:24:04', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-09T07:53:39.408 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T07:53:39.410 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T07:53:39.457 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T07:53:39.467 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T07:53:39.523 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:39.523 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T07:53:39.547 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T07:53:39.547 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 2024-05-09T07:53:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T07:53:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T07:53:39.603 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-09T07:53:39.603 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T07:53:39.603 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T07:53:39.603 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-09 07:53:10.662548927 +0000 2024-05-09T07:53:39.603 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-09 07:51:16.147328192 +0000 2024-05-09T07:53:39.603 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-09 07:51:16.147328192 +0000 2024-05-09T07:53:39.603 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-09 07:51:16.147328192 +0000 2024-05-09T07:53:39.604 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T07:53:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-09T07:53:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-09T07:53:39.667 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000277876 s, 1.8 MB/s 2024-05-09T07:53:39.668 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T07:53:39.725 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 2024-05-09T07:53:39.780 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T07:53:39.780 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T07:53:39.781 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-09T07:53:39.781 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T07:53:39.781 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T07:53:39.781 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-09 07:53:10.662548927 +0000 2024-05-09T07:53:39.781 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-09 07:51:16.509320108 +0000 2024-05-09T07:53:39.781 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-09 07:51:16.509320108 +0000 2024-05-09T07:53:39.781 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-09 07:51:16.509320108 +0000 2024-05-09T07:53:39.781 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T07:53:39.844 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-09T07:53:39.844 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-09T07:53:39.844 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000210115 s, 2.4 MB/s 2024-05-09T07:53:39.846 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T07:53:39.902 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 2024-05-09T07:53:39.957 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T07:53:39.957 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T07:53:39.957 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-09T07:53:39.957 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T07:53:39.957 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T07:53:39.957 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-09 07:53:10.662548927 +0000 2024-05-09T07:53:39.958 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-09 07:51:16.865312157 +0000 2024-05-09T07:53:39.958 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-09 07:51:16.865312157 +0000 2024-05-09T07:53:39.958 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-09 07:51:16.865312157 +0000 2024-05-09T07:53:39.958 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T07:53:40.020 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-09T07:53:40.020 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-09T07:53:40.021 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000270225 s, 1.9 MB/s 2024-05-09T07:53:40.022 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T07:53:40.078 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 2024-05-09T07:53:40.134 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T07:53:40.135 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T07:53:40.135 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-09T07:53:40.135 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T07:53:40.135 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T07:53:40.135 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2024-05-09 07:53:10.663548905 +0000 2024-05-09T07:53:40.135 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-09 07:51:17.213304386 +0000 2024-05-09T07:53:40.135 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-09 07:51:17.213304386 +0000 2024-05-09T07:53:40.135 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: 2024-05-09 07:51:17.213304386 +0000 2024-05-09T07:53:40.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T07:53:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2024-05-09T07:53:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2024-05-09T07:53:40.198 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000209382 s, 2.4 MB/s 2024-05-09T07:53:40.199 DEBUG:teuthology.orchestra.run.smithi087:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T07:53:40.256 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:40.256 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:53:40.256 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T07:53:40.274 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T07:53:40.274 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-05-09T07:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T07:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T07:53:40.332 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-09T07:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T07:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T07:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 07:53:29.548444113 +0000 2024-05-09T07:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 07:51:18.511479209 +0000 2024-05-09T07:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 07:51:18.511479209 +0000 2024-05-09T07:53:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-05-09 07:51:18.511479209 +0000 2024-05-09T07:53:40.333 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T07:53:40.397 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T07:53:40.398 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T07:53:40.398 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000110319 s, 4.6 MB/s 2024-05-09T07:53:40.399 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T07:53:40.457 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-05-09T07:53:40.514 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T07:53:40.514 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T07:53:40.514 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-09T07:53:40.514 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T07:53:40.514 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T07:53:40.514 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 07:53:29.549444097 +0000 2024-05-09T07:53:40.514 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 07:51:18.841473475 +0000 2024-05-09T07:53:40.514 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 07:51:18.841473475 +0000 2024-05-09T07:53:40.514 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-05-09 07:51:18.841473475 +0000 2024-05-09T07:53:40.515 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T07:53:40.579 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T07:53:40.579 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T07:53:40.579 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.1308e-05 s, 5.6 MB/s 2024-05-09T07:53:40.580 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T07:53:40.637 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-05-09T07:53:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T07:53:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T07:53:40.693 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-09T07:53:40.693 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T07:53:40.693 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T07:53:40.693 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 07:53:29.549444097 +0000 2024-05-09T07:53:40.693 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 07:51:19.185467498 +0000 2024-05-09T07:53:40.694 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 07:51:19.185467498 +0000 2024-05-09T07:53:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-05-09 07:51:19.185467498 +0000 2024-05-09T07:53:40.694 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T07:53:40.757 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T07:53:40.757 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T07:53:40.757 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000102833 s, 5.0 MB/s 2024-05-09T07:53:40.758 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T07:53:40.815 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-05-09T07:53:40.870 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T07:53:40.871 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T07:53:40.871 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-09T07:53:40.871 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T07:53:40.871 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T07:53:40.871 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-05-09 07:53:29.549444097 +0000 2024-05-09T07:53:40.871 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-05-09 07:51:19.535461417 +0000 2024-05-09T07:53:40.871 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-05-09 07:51:19.535461417 +0000 2024-05-09T07:53:40.871 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-05-09 07:51:19.535461417 +0000 2024-05-09T07:53:40.871 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T07:53:40.934 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-05-09T07:53:40.934 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-05-09T07:53:40.934 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000102719 s, 5.0 MB/s 2024-05-09T07:53:40.935 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T07:53:40.991 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:40.991 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T07:53:40.991 INFO:tasks.ceph:Generating config... 2024-05-09T07:53:40.993 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-09T07:53:40.993 INFO:tasks.ceph:[client] debug client = 20 2024-05-09T07:53:40.993 INFO:tasks.ceph:[client] debug ms = 1 2024-05-09T07:53:40.993 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-09T07:53:40.993 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-09T07:53:40.993 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-09T07:53:40.993 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-09T07:53:40.993 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-09T07:53:40.993 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-09T07:53:40.993 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] mds inject traceless reply probability = 0.5 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-09T07:53:40.994 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-09T07:53:40.995 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-09T07:53:40.995 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-09T07:53:40.995 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-09T07:53:40.995 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-09T07:53:40.995 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-09T07:53:40.996 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-09T07:53:40.996 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-09T07:53:40.996 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-09T07:53:40.996 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-09T07:53:40.996 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-09T07:53:40.996 INFO:tasks.ceph:Setting up mon.a... 2024-05-09T07:53:40.996 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-09T07:53:41.047 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.keyring 2024-05-09T07:53:41.050 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-09T07:53:41.095 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T07:53:41.120 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.87'), ('mon.b', '172.21.15.110'), ('mon.c', '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]')] 2024-05-09T07:53:41.120 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.87,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-09T07:53:41.121 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:41.121 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T07:53:41.178 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.87 --add b 172.21.15.110 --addv c '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:53:41.264 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:53:41.264 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: generated fsid afc7678c-ec1c-4af0-8515-296a1e5375c0 2024-05-09T07:53:41.264 INFO:teuthology.orchestra.run.smithi087.stdout:setting min_mon_release = quincy 2024-05-09T07:53:41.264 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 0 2024-05-09T07:53:41.265 INFO:teuthology.orchestra.run.smithi087.stdout:fsid afc7678c-ec1c-4af0-8515-296a1e5375c0 2024-05-09T07:53:41.265 INFO:teuthology.orchestra.run.smithi087.stdout:last_changed 2024-05-09T07:53:41.250611+0000 2024-05-09T07:53:41.265 INFO:teuthology.orchestra.run.smithi087.stdout:created 2024-05-09T07:53:41.250611+0000 2024-05-09T07:53:41.265 INFO:teuthology.orchestra.run.smithi087.stdout:min_mon_release 17 (quincy) 2024-05-09T07:53:41.265 INFO:teuthology.orchestra.run.smithi087.stdout:election_strategy: 1 2024-05-09T07:53:41.265 INFO:teuthology.orchestra.run.smithi087.stdout:0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2024-05-09T07:53:41.265 INFO:teuthology.orchestra.run.smithi087.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-05-09T07:53:41.266 INFO:teuthology.orchestra.run.smithi087.stdout:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-05-09T07:53:41.266 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-09T07:53:41.267 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T07:53:41.283 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID afc7678c-ec1c-4af0-8515-296a1e5375c0... 2024-05-09T07:53:41.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T07:53:41.325 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T07:53:41.365 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-05-09T07:53:41.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-05-09T07:53:41.367 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.368 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.87,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = afc7678c-ec1c-4af0-8515-296a1e5375c0 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-05-09T07:53:41.369 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug trim objects = true 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-05-09T07:53:41.370 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-05-09T07:53:41.371 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore allocator = bitmap 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-05-09T07:53:41.372 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-09T07:53:41.373 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T07:53:41.374 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: mon down mkfs grace = 300 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-05-09T07:53:41.375 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-05-09T07:53:41.376 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds balancer = 20 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal fragment size max = 10000 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal merge size = 5 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split bits = 3 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split size = 100 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: mds inject traceless reply probability = 0.5 2024-05-09T07:53:41.377 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2024-05-09T07:53:41.378 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2024-05-09T07:53:41.378 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-05-09T07:53:41.378 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-05-09T07:53:41.378 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-05-09T07:53:41.378 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-05-09T07:53:41.378 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-05-09T07:53:41.379 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-05-09T07:53:41.380 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-05-09T07:53:41.381 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-05-09T07:53:41.382 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.87,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-05-09T07:53:41.382 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = afc7678c-ec1c-4af0-8515-296a1e5375c0 2024-05-09T07:53:41.382 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.382 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-05-09T07:53:41.382 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-05-09T07:53:41.382 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.382 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-05-09T07:53:41.382 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-05-09T07:53:41.382 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.383 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: bdev async discard = True 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: bdev enable discard = True 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore allocator = bitmap 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-05-09T07:53:41.384 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-05-09T07:53:41.385 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-05-09T07:53:41.386 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-05-09T07:53:41.387 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-05-09T07:53:41.387 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-05-09T07:53:41.387 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-05-09T07:53:41.387 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-05-09T07:53:41.387 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-05-09T07:53:41.387 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-05-09T07:53:41.387 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-05-09T07:53:41.387 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: mon down mkfs grace = 300 2024-05-09T07:53:41.388 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-05-09T07:53:41.389 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal fragment size max = 10000 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal merge size = 5 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split bits = 3 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split size = 100 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-05-09T07:53:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2024-05-09T07:53:41.391 INFO:teuthology.orchestra.run.smithi110.stdout: mds inject traceless reply probability = 0.5 2024-05-09T07:53:41.391 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-05-09T07:53:41.391 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2024-05-09T07:53:41.391 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-05-09T07:53:41.391 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-05-09T07:53:41.391 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-05-09T07:53:41.392 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-09T07:53:41.393 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-09T07:53:41.487 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-09T07:53:41.488 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:41.488 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-09T07:53:41.503 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:41.503 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-09T07:53:41.558 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T07:53:41.559 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:41.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T07:53:41.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T07:53:41.634 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:53:41.634 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:53:41.689 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T07:53:41.689 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:53:41.690 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T07:53:41.690 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T07:53:41.725 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:53:41.725 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:53:41.783 INFO:tasks.ceph:Setting up mon nodes... 2024-05-09T07:53:41.784 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-09T07:53:41.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T07:53:41.834 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T07:53:41.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T07:53:41.913 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T07:53:41.916 INFO:tasks.ceph:Setting up mds nodes... 2024-05-09T07:53:41.916 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T07:53:41.967 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T07:53:41.969 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-09T07:53:41.994 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T07:53:42.044 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T07:53:42.047 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-09T07:53:42.071 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-09T07:53:42.072 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T07:53:42.112 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-09T07:53:42.124 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-09T07:53:42.124 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T07:53:42.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-09T07:53:42.189 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:42.189 INFO:tasks.ceph:role: osd.0 2024-05-09T07:53:42.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T07:53:42.189 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T07:53:42.261 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T07:53:42.261 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T07:53:42.261 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T07:53:42.261 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T07:53:42.262 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T07:53:42.262 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-09T07:53:42.262 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T07:53:42.262 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T07:53:42.262 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T07:53:42.262 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T07:53:42.771 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-09T07:53:42.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-09T07:53:42.773 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-09T07:53:42.915 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-09T07:53:42.946 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-09T07:53:43.012 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:43.013 INFO:tasks.ceph:role: osd.1 2024-05-09T07:53:43.013 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T07:53:43.013 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T07:53:43.086 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T07:53:43.534 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-09T07:53:43.535 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-09T07:53:43.535 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-09T07:53:43.619 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-09T07:53:43.689 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-09T07:53:43.755 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:43.755 INFO:tasks.ceph:role: osd.2 2024-05-09T07:53:43.755 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T07:53:43.755 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T07:53:43.827 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T07:53:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T07:53:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T07:53:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T07:53:43.827 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T07:53:43.827 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-09T07:53:43.827 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T07:53:43.827 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T07:53:43.828 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T07:53:43.828 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T07:53:44.366 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-09T07:53:44.368 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-09T07:53:44.368 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-09T07:53:44.500 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-09T07:53:44.531 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-09T07:53:44.596 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:44.596 INFO:tasks.ceph:role: osd.3 2024-05-09T07:53:44.597 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T07:53:44.597 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T07:53:44.670 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T07:53:45.188 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2024-05-09T07:53:45.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2024-05-09T07:53:45.190 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-09T07:53:45.304 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-09T07:53:45.336 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:53:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:45.420+0000 7fbfdd80c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-09T07:53:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:45.421+0000 7fbfdd80c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-09T07:53:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:45.421+0000 7fbfdd80c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T07:53:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:45.421+0000 7fbfdd80c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T07:53:45.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:45.421+0000 7fbfdd80c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T07:53:45.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:45.421+0000 7fbfdd80c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-09T07:53:48.287 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T07:53:48.313 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:53:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:48.385+0000 7fbe1b00c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-09T07:53:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:48.385+0000 7fbe1b00c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-09T07:53:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:48.385+0000 7fbe1b00c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T07:53:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:48.385+0000 7fbe1b00c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T07:53:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:48.385+0000 7fbe1b00c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T07:53:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:48.385+0000 7fbe1b00c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-09T07:53:51.253 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T07:53:51.281 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:53:51.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:51.355+0000 7fee3e227640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-09T07:53:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:51.355+0000 7fee3e227640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-09T07:53:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:51.355+0000 7fee3e227640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T07:53:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:51.355+0000 7fee3e227640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T07:53:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:51.355+0000 7fee3e227640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T07:53:51.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:51.355+0000 7fee3e227640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-09T07:53:54.222 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T07:53:54.248 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:53:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:54.321+0000 7f280fa1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-09T07:53:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:54.321+0000 7f280fa1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-09T07:53:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:54.321+0000 7f280fa1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T07:53:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:54.321+0000 7f280fa1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T07:53:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:54.321+0000 7f280fa1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T07:53:54.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:53:54.322+0000 7f280fa1e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-09T07:53:57.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T07:53:57.224 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-09T07:53:57.254 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:57.254 INFO:tasks.ceph:role: osd.4 2024-05-09T07:53:57.254 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T07:53:57.254 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T07:53:57.322 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T07:53:57.322 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T07:53:57.323 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T07:53:57.323 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T07:53:57.323 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T07:53:57.323 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-05-09T07:53:57.323 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T07:53:57.323 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T07:53:57.323 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T07:53:57.323 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T07:53:57.355 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-05-09T07:53:57.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-05-09T07:53:57.357 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-09T07:53:57.427 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-09T07:53:57.500 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-09T07:53:57.565 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:57.566 INFO:tasks.ceph:role: osd.5 2024-05-09T07:53:57.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T07:53:57.566 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T07:53:57.630 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T07:53:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T07:53:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T07:53:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T07:53:57.630 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T07:53:57.630 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-05-09T07:53:57.630 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T07:53:57.631 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T07:53:57.631 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T07:53:57.631 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T07:53:57.662 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-05-09T07:53:57.664 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-05-09T07:53:57.664 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-09T07:53:57.732 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-09T07:53:57.801 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-09T07:53:57.867 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:57.867 INFO:tasks.ceph:role: osd.6 2024-05-09T07:53:57.867 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T07:53:57.867 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T07:53:57.932 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T07:53:57.932 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T07:53:57.932 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T07:53:57.932 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T07:53:57.932 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T07:53:57.932 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-05-09T07:53:57.932 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T07:53:57.932 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T07:53:57.933 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T07:53:57.933 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T07:53:57.964 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-05-09T07:53:57.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-05-09T07:53:57.966 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-09T07:53:58.036 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-09T07:53:58.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-09T07:53:58.170 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T07:53:58.170 INFO:tasks.ceph:role: osd.7 2024-05-09T07:53:58.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T07:53:58.170 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T07:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T07:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T07:53:58.235 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T07:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T07:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T07:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-05-09T07:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T07:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T07:53:58.236 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T07:53:58.237 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T07:53:58.267 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-05-09T07:53:58.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-05-09T07:53:58.270 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-09T07:53:58.339 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-09T07:53:58.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:53:58.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:53:58.486+0000 7f6dc2a20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-09T07:53:58.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:53:58.486+0000 7f6dc2a20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-09T07:53:58.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:53:58.486+0000 7f6dc2a20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T07:53:58.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:53:58.486+0000 7f6dc2a20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T07:53:58.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:53:58.486+0000 7f6dc2a20640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T07:53:58.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:53:58.486+0000 7f6dc2a20640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-09T07:54:01.351 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T07:54:01.379 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:54:01.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:01.453+0000 7fc21a9dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-09T07:54:01.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:01.453+0000 7fc21a9dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-09T07:54:01.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:01.454+0000 7fc21a9dc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T07:54:01.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:01.454+0000 7fc21a9dc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T07:54:01.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:01.454+0000 7fc21a9dc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T07:54:01.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:01.454+0000 7fc21a9dc640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-09T07:54:04.318 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T07:54:04.348 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:54:04.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:04.425+0000 7f06b1af0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-09T07:54:04.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:04.425+0000 7f06b1af0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-09T07:54:04.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:04.425+0000 7f06b1af0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T07:54:04.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:04.425+0000 7f06b1af0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T07:54:04.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:04.425+0000 7f06b1af0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T07:54:04.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:04.426+0000 7f06b1af0640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-09T07:54:07.281 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-09T07:54:07.310 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:54:07.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:07.387+0000 7f221bd57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-09T07:54:07.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:07.387+0000 7f221bd57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-09T07:54:07.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:07.387+0000 7f221bd57640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T07:54:07.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:07.387+0000 7f221bd57640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T07:54:07.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:07.387+0000 7f221bd57640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T07:54:07.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:07.387+0000 7f221bd57640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-09T07:54:09.410 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:54:09.412 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:54:10.251 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-09T07:54:10.277 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-09T07:54:10.278 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:10.278 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-09T07:54:10.308 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:10.308 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-09T07:54:10.378 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:10.378 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-09T07:54:10.447 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:10.447 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-09T07:54:10.514 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:10.515 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-09T07:54:10.582 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:10.582 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-09T07:54:10.652 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:10.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-09T07:54:10.679 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:10.679 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-09T07:54:10.745 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:10.745 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-09T07:54:10.810 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:10.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-09T07:54:10.875 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:10.875 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-09T07:54:10.940 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:10.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-09T07:54:11.004 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:11.005 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-09T07:54:11.022 INFO:tasks.ceph:Adding keys to all mons... 2024-05-09T07:54:11.022 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T07:54:11.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T07:54:11.088 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAFgTxm4m33MBAAkFZbUbuWoMps7z6JfyLe0Q== 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAFgTxmdlzaOBAAsOm6Bcya2p/w3PwZRWusFA== 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAJgTxmWT4iGRAA0E+I9JUB3uh3jllZr2i9ew== 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAMgTxm2b0BFxAAa806GXuqwTqRRna2HvjEgg== 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAPgTxm0uk3FRAASpHOpTQhGEY6H8+0NA+Hxw== 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQASgTxmZGY3ExAAZRdoAB5VnAdFWJWPhIyG8A== 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-05-09T07:54:11.089 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAFgTxm2KWhNRAAr3ovKzbs5v23D+4cwBKPQQ== 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAGgTxmEvHeARAA7OJMANtykWhQc4zLNTIaPw== 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAWgTxmKP0VHRAAfxQWAv8KUcXrdZ0G/76nNA== 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAZgTxmuk8bGxAAv5X+OoJK0eBVt/oHrpTJLA== 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAcgTxmxctrGRAAYdrm1Up9zkRYnqyPH2m7zw== 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAfgTxmG6QhFxAAhqTjtdrhyRawqt/OLKkFhg== 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAGgTxmP5HhBRAAquGThoQ4Em8xJsf1ER+6rw== 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2024-05-09T07:54:11.090 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAFgTxm4m33MBAAkFZbUbuWoMps7z6JfyLe0Q== 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAFgTxmdlzaOBAAsOm6Bcya2p/w3PwZRWusFA== 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAJgTxmWT4iGRAA0E+I9JUB3uh3jllZr2i9ew== 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAMgTxm2b0BFxAAa806GXuqwTqRRna2HvjEgg== 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAPgTxm0uk3FRAASpHOpTQhGEY6H8+0NA+Hxw== 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQASgTxmZGY3ExAAZRdoAB5VnAdFWJWPhIyG8A== 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAFgTxm2KWhNRAAr3ovKzbs5v23D+4cwBKPQQ== 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAGgTxmEvHeARAA7OJMANtykWhQc4zLNTIaPw== 2024-05-09T07:54:11.091 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2024-05-09T07:54:11.092 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAWgTxmKP0VHRAAfxQWAv8KUcXrdZ0G/76nNA== 2024-05-09T07:54:11.092 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2024-05-09T07:54:11.092 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAZgTxmuk8bGxAAv5X+OoJK0eBVt/oHrpTJLA== 2024-05-09T07:54:11.092 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2024-05-09T07:54:11.092 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAcgTxmxctrGRAAYdrm1Up9zkRYnqyPH2m7zw== 2024-05-09T07:54:11.092 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2024-05-09T07:54:11.092 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAfgTxmG6QhFxAAhqTjtdrhyRawqt/OLKkFhg== 2024-05-09T07:54:11.092 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2024-05-09T07:54:11.092 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQAGgTxmP5HhBRAAquGThoQ4Em8xJsf1ER+6rw== 2024-05-09T07:54:11.093 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T07:54:11.137 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T07:54:11.189 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T07:54:11.191 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T07:54:11.245 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.247 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.297 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.300 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.350 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.352 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.403 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.405 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.455 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T07:54:11.457 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T07:54:11.507 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T07:54:11.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T07:54:11.562 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.564 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.614 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.617 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.667 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.672 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.724 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.728 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T07:54:11.779 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T07:54:11.784 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T07:54:11.842 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-09T07:54:11.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-09T07:54:11.867 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T07:54:11.964 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-09T07:54:11.989 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-09T07:54:12.018 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T07:54:12.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-09T07:54:12.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-09T07:54:12.211 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T07:54:12.312 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-09T07:54:12.341 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:54:12.344 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T07:54:12.397 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-09T07:54:12.398 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-09T07:54:12.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-09T07:54:12.402 INFO:tasks.ceph.mon.a:Started 2024-05-09T07:54:12.402 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-09T07:54:12.402 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-09T07:54:12.441 INFO:tasks.ceph.mon.b:Started 2024-05-09T07:54:12.442 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-09T07:54:12.442 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-09T07:54:12.446 INFO:tasks.ceph.mon.c:Started 2024-05-09T07:54:12.446 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-09T07:54:12.447 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-09T07:54:12.447 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-09T07:54:12.450 INFO:tasks.ceph.mgr.y:Started 2024-05-09T07:54:12.450 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-09T07:54:12.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-09T07:54:12.453 INFO:tasks.ceph.mgr.x:Started 2024-05-09T07:54:12.453 INFO:tasks.ceph:Setting crush tunables to default 2024-05-09T07:54:12.453 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd crush tunables default 2024-05-09T07:54:12.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.539+0000 7f51bf658640 1 Processor -- start 2024-05-09T07:54:12.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.539+0000 7f51bf658640 1 -- start start 2024-05-09T07:54:12.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.540+0000 7f51bf658640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 0x7f51b814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:12.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.540+0000 7f51bf658640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b80b9920 con 0x7f51b80b5600 2024-05-09T07:54:12.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.540+0000 7f51bf658640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b80b50a0 con 0x7f51b8141ce0 2024-05-09T07:54:12.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.540+0000 7f51bf658640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f51b80b5a90 con 0x7f51b814afe0 2024-05-09T07:54:12.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.540+0000 7f51bcbf3640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f51b80b5600 0x7f51b81415d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34706/0 (socket says 172.21.15.87:34706) 2024-05-09T07:54:12.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.540+0000 7f51bcbf3640 1 -- 172.21.15.87:0/2430592794 learned_addr learned my addr 172.21.15.87:0/2430592794 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:12.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.540+0000 7f51bd3f4640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 0x7f51b814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:12.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.541+0000 7f51bd3f4640 1 -- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 msgr2=0x7f51b814b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-09T07:54:12.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.541+0000 7f51bd3f4640 1 -- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 msgr2=0x7f51b814b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T07:54:12.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.541+0000 7f51bd3f4640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 0x7f51b814b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T07:54:12.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.541+0000 7f51bd3f4640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 0x7f51b814b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T07:54:12.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846668733 0 0) 0x7f51a8001110 con 0x7f51b80b5600 2024-05-09T07:54:12.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51a4003520 con 0x7f51b80b5600 2024-05-09T07:54:12.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183896133 0 0) 0x7f51b80b50a0 con 0x7f51b8141ce0 2024-05-09T07:54:12.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51a8001110 con 0x7f51b8141ce0 2024-05-09T07:54:12.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1554459866 0 0) 0x7f51a4003520 con 0x7f51b80b5600 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 msgr2=0x7f51b814b3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 0x7f51b814b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 >> v1:172.21.15.110:6789/0 conn(0x7f51b8141ce0 legacy=0x7f51b81520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b80b5ce0 con 0x7f51b80b5600 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f51a8001840 con 0x7f51b80b5600 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 >> v1:172.21.15.87:6789/0 conn(0x7f51b80b5600 legacy=0x7f51b81415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51a4003ba0 0x7f51a4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 0x7f51a4005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f51b80b5a90 con 0x7f51a4004800 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f51a400bb50 con 0x7f51a4003ba0 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.691+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f51a400bd50 con 0x7f51b814afe0 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.692+0000 7f51bcbf3640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:12.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.692+0000 7f51bd3f4640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51a4003ba0 0x7f51a4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:12.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.692+0000 7f51bdbf5640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 0x7f51a4005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:12.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.692+0000 7f51bcbf3640 1 -- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 msgr2=0x7f51a4005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:12.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.692+0000 7f51bcbf3640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b814afe0 0x7f51a4005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:12.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.692+0000 7f51bcbf3640 1 -- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51a4003ba0 msgr2=0x7f51a4003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:12.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.692+0000 7f51bcbf3640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51a4003ba0 0x7f51a4003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:12.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.692+0000 7f51bcbf3640 1 -- 172.21.15.87:0/2430592794 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a4003520 con 0x7f51a4004800 2024-05-09T07:54:12.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.693+0000 7f51bcbf3640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51a4004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f51b80b59e0 tx=0x7f51a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48790bf9641f738f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:12.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.693+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8035070 con 0x7f51a4004800 2024-05-09T07:54:12.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.693+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a802c040 con 0x7f51a4004800 2024-05-09T07:54:12.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.693+0000 7f51affff640 1 -- 172.21.15.87:0/2430592794 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a800c0e0 con 0x7f51a4004800 2024-05-09T07:54:12.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.694+0000 7f51bf658640 1 -- 172.21.15.87:0/2430592794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 msgr2=0x7f51a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:12.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.694+0000 7f51bf658640 1 --2- 172.21.15.87:0/2430592794 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51a4004c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f51b80b59e0 tx=0x7f51a4005830 comp rx=0 tx=0).stop 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.694+0000 7f51bdbf5640 1 -- 172.21.15.87:0/2430592794 reap_dead start 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.694+0000 7f51bf658640 1 -- 172.21.15.87:0/2430592794 shutdown_connections 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.694+0000 7f51bf658640 1 -- 172.21.15.87:0/2430592794 >> 172.21.15.87:0/2430592794 conn(0x7f51b80bd0e0 msgr2=0x7f51b80bd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.694+0000 7f51bf658640 1 -- 172.21.15.87:0/2430592794 shutdown_connections 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.694+0000 7f51bf658640 1 -- 172.21.15.87:0/2430592794 wait complete. 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.695+0000 7f51bf658640 1 Processor -- start 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.695+0000 7f51bf658640 1 -- start start 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bf658640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51b81dcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bf658640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b81e0d50 0x7f51b81d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bf658640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81d07f0 0x7f51b813c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bf658640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f51b80b4e40 con 0x7f51a4004800 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bf658640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f51b80b4cc0 con 0x7f51b81d07f0 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bf658640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f51b80bdc00 con 0x7f51b81e0d50 2024-05-09T07:54:12.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bd3f4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51b81dcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bd3f4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51b81dcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41102/0 (socket says 172.21.15.87:41102) 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bd3f4640 1 -- 172.21.15.87:0/4803424 learned_addr learned my addr 172.21.15.87:0/4803424 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bdbf5640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81d07f0 0x7f51b813c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bcbf3640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b81e0d50 0x7f51b81d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bd3f4640 1 -- 172.21.15.87:0/4803424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b81e0d50 msgr2=0x7f51b81d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bd3f4640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b81e0d50 0x7f51b81d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bd3f4640 1 -- 172.21.15.87:0/4803424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81d07f0 msgr2=0x7f51b813c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bd3f4640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81d07f0 0x7f51b813c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bd3f4640 1 -- 172.21.15.87:0/4803424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b81dd020 con 0x7f51a4004800 2024-05-09T07:54:12.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bcbf3640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b81e0d50 0x7f51b81d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bd3f4640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51b81dcae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f51b4007fa0 tx=0x7f51b400f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51adffb640 1 -- 172.21.15.87:0/4803424 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4015670 con 0x7f51a4004800 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51adffb640 1 -- 172.21.15.87:0/4803424 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b401a070 con 0x7f51a4004800 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51bf658640 1 -- 172.21.15.87:0/4803424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b81d1c30 con 0x7f51a4004800 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.696+0000 7f51adffb640 1 -- 172.21.15.87:0/4803424 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4015a30 con 0x7f51a4004800 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.697+0000 7f51adffb640 1 -- 172.21.15.87:0/4803424 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f51b401e410 con 0x7f51a4004800 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.697+0000 7f51bf658640 1 -- 172.21.15.87:0/4803424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b81e0830 con 0x7f51a4004800 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.697+0000 7f51adffb640 1 -- 172.21.15.87:0/4803424 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f51b40143d0 con 0x7f51a4004800 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.697+0000 7f51bf658640 1 -- 172.21.15.87:0/4803424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b81e0380 con 0x7f51a4004800 2024-05-09T07:54:12.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.700+0000 7f51adffb640 1 -- 172.21.15.87:0/4803424 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f51b40148c0 con 0x7f51a4004800 2024-05-09T07:54:12.813 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:12.798+0000 7f6df880e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T07:54:12.824 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.809+0000 7f51bf658640 1 -- 172.21.15.87:0/4803424 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f51b8068bb0 con 0x7f51a4004800 2024-05-09T07:54:12.825 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.811+0000 7f51adffb640 1 -- 172.21.15.87:0/4803424 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f51b8068bb0 con 0x7f51a4004800 2024-05-09T07:54:12.825 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2024-05-09T07:54:12.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.812+0000 7f51bf658640 1 -- 172.21.15.87:0/4803424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 msgr2=0x7f51b81dcae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:12.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.812+0000 7f51bf658640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51b81dcae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f51b4007fa0 tx=0x7f51b400f5e0 comp rx=0 tx=0).stop 2024-05-09T07:54:12.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.812+0000 7f51bf658640 1 -- 172.21.15.87:0/4803424 shutdown_connections 2024-05-09T07:54:12.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.812+0000 7f51bf658640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b81e0d50 0x7f51b81d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:12.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.812+0000 7f51bf658640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81d07f0 0x7f51b813c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:12.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.812+0000 7f51bf658640 1 --2- 172.21.15.87:0/4803424 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f51a4004800 0x7f51b81dcae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:12.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.812+0000 7f51bf658640 1 -- 172.21.15.87:0/4803424 >> 172.21.15.87:0/4803424 conn(0x7f51b80bd0e0 msgr2=0x7f51b813e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:12.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.812+0000 7f51bf658640 1 -- 172.21.15.87:0/4803424 shutdown_connections 2024-05-09T07:54:12.828 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:12.812+0000 7f51bf658640 1 -- 172.21.15.87:0/4803424 wait complete. 2024-05-09T07:54:12.838 INFO:tasks.ceph:check_enable_crimson: False 2024-05-09T07:54:12.838 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-09T07:54:12.838 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:12.838 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-09T07:54:12.863 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:12.863 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-09T07:54:12.864 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:12.849+0000 7fdf49528040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T07:54:12.930 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:12.930 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-09T07:54:12.972 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:12.957+0000 7f6df880e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T07:54:12.995 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:54:12.995 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-09T07:54:13.023 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:13.009+0000 7f6df880e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T07:54:13.058 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:13.043+0000 7fdf49528040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T07:54:13.060 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:13.060 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-09T07:54:13.085 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:13.085 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-09T07:54:13.112 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:13.098+0000 7fdf49528040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T07:54:13.152 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:13.152 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-09T07:54:13.217 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-05-09T07:54:13.218 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-09T07:54:13.273 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:13.259+0000 7f6df880e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T07:54:13.282 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 6c73afe3-24ba-499d-b59f-d0541e2feef3 0 2024-05-09T07:54:13.321 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:13.306+0000 7f6df880e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T07:54:13.366 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:13.351+0000 7fdf49528040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T07:54:13.411 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:13.397+0000 7fdf49528040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T07:54:13.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.405+0000 7f94df7b7640 1 Processor -- start 2024-05-09T07:54:13.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.405+0000 7f94df7b7640 1 -- start start 2024-05-09T07:54:13.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94df7b7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f94d80af520 0x7f94d80729b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94df7b7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94d81444a0 0x7f94d8072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94df7b7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d80af900 con 0x7f94d80b5d80 2024-05-09T07:54:13.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94df7b7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f94d80b08c0 con 0x7f94d80af520 2024-05-09T07:54:13.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94df7b7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f94d8144a30 con 0x7f94d81444a0 2024-05-09T07:54:13.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94dcd52640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94d81444a0 0x7f94d8072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94dcd52640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94d81444a0 0x7f94d8072ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60198/0 (socket says 172.21.15.110:60198) 2024-05-09T07:54:13.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94dcd52640 1 -- 172.21.15.110:0/426902569 learned_addr learned my addr 172.21.15.110:0/426902569 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:13.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94dd553640 1 --2- 172.21.15.110:0/426902569 >> v2:172.21.15.87:3300/0 conn(0x7f94d80af520 0x7f94d80729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94dcd52640 1 -- 172.21.15.110:0/426902569 >> v2:172.21.15.87:3300/0 conn(0x7f94d80af520 msgr2=0x7f94d80729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:13.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94dcd52640 1 --2- 172.21.15.110:0/426902569 >> v2:172.21.15.87:3300/0 conn(0x7f94d80af520 0x7f94d80729b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94dcd52640 1 -- 172.21.15.110:0/426902569 >> v1:172.21.15.87:6789/0 conn(0x7f94d80b5d80 legacy=0x7f94d8145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.406+0000 7f94dcd52640 1 -- 172.21.15.110:0/426902569 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d8144d10 con 0x7f94d81444a0 2024-05-09T07:54:13.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.407+0000 7f94dcd52640 1 --2- 172.21.15.110:0/426902569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 0x7f94d8072ef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94d8070290 tx=0x7f94cc02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c422c0437a7177b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:13.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.407+0000 7f94cbfff640 1 -- 172.21.15.110:0/426902569 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc037070 con 0x7f94d81444a0 2024-05-09T07:54:13.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.407+0000 7f94cbfff640 1 -- 172.21.15.110:0/426902569 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94cc032440 con 0x7f94d81444a0 2024-05-09T07:54:13.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.407+0000 7f94cbfff640 1 -- 172.21.15.110:0/426902569 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc032810 con 0x7f94d81444a0 2024-05-09T07:54:13.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.408+0000 7f94df7b7640 1 -- 172.21.15.110:0/426902569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 msgr2=0x7f94d8072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.408+0000 7f94df7b7640 1 --2- 172.21.15.110:0/426902569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 0x7f94d8072ef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94d8070290 tx=0x7f94cc02a1e0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.408+0000 7f94df7b7640 1 -- 172.21.15.110:0/426902569 shutdown_connections 2024-05-09T07:54:13.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.408+0000 7f94df7b7640 1 --2- 172.21.15.110:0/426902569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 0x7f94d8072ef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.408+0000 7f94df7b7640 1 --2- 172.21.15.110:0/426902569 >> v2:172.21.15.87:3300/0 conn(0x7f94d80af520 0x7f94d80729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.408+0000 7f94df7b7640 1 -- 172.21.15.110:0/426902569 >> 172.21.15.110:0/426902569 conn(0x7f94d80b69c0 msgr2=0x7f94d80b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:13.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.408+0000 7f94df7b7640 1 -- 172.21.15.110:0/426902569 shutdown_connections 2024-05-09T07:54:13.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.408+0000 7f94df7b7640 1 -- 172.21.15.110:0/426902569 wait complete. 2024-05-09T07:54:13.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94df7b7640 1 Processor -- start 2024-05-09T07:54:13.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94df7b7640 1 -- start start 2024-05-09T07:54:13.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94df7b7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d80af520 0x7f94d81e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94df7b7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94d80b5d80 0x7f94d806b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94df7b7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 0x7f94d806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94df7b7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f94d81461a0 con 0x7f94d80b5d80 2024-05-09T07:54:13.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94df7b7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8146020 con 0x7f94d81444a0 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94df7b7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f94d814ed60 con 0x7f94d80af520 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94dd553640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d80af520 0x7f94d81e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94dd553640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d80af520 0x7f94d81e06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43244/0 (socket says 172.21.15.110:43244) 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94dd553640 1 -- 172.21.15.110:0/2253004608 learned_addr learned my addr 172.21.15.110:0/2253004608 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.409+0000 7f94ddd54640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 0x7f94d806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94dcd52640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94d80b5d80 0x7f94d806b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94dd553640 1 -- 172.21.15.110:0/2253004608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 msgr2=0x7f94d806ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94dd553640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 0x7f94d806ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94dd553640 1 -- 172.21.15.110:0/2253004608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94d80b5d80 msgr2=0x7f94d806b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94dd553640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94d80b5d80 0x7f94d806b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94dd553640 1 -- 172.21.15.110:0/2253004608 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d81e0f80 con 0x7f94d80af520 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94ddd54640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 0x7f94d806ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94dcd52640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94d80b5d80 0x7f94d806b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94dd553640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d80af520 0x7f94d81e06c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94d400e9b0 tx=0x7f94d400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:13.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94c9ffb640 1 -- 172.21.15.110:0/2253004608 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4017070 con 0x7f94d80af520 2024-05-09T07:54:13.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94c9ffb640 1 -- 172.21.15.110:0/2253004608 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d400c9a0 con 0x7f94d80af520 2024-05-09T07:54:13.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94c9ffb640 1 -- 172.21.15.110:0/2253004608 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d400cd90 con 0x7f94d80af520 2024-05-09T07:54:13.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94df7b7640 1 -- 172.21.15.110:0/2253004608 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d81e1260 con 0x7f94d80af520 2024-05-09T07:54:13.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.410+0000 7f94df7b7640 1 -- 172.21.15.110:0/2253004608 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d81dd150 con 0x7f94d80af520 2024-05-09T07:54:13.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.411+0000 7f94c9ffb640 1 -- 172.21.15.110:0/2253004608 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f94d401a070 con 0x7f94d80af520 2024-05-09T07:54:13.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.411+0000 7f94c9ffb640 1 -- 172.21.15.110:0/2253004608 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f94d401c8d0 con 0x7f94d80af520 2024-05-09T07:54:13.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.411+0000 7f94df7b7640 1 -- 172.21.15.110:0/2253004608 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d80691f0 con 0x7f94d80af520 2024-05-09T07:54:13.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.415+0000 7f94c9ffb640 1 -- 172.21.15.110:0/2253004608 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f94d4013470 con 0x7f94d80af520 2024-05-09T07:54:13.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.487+0000 7f94df7b7640 1 -- 172.21.15.110:0/2253004608 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6c73afe3-24ba-499d-b59f-d0541e2feef3", "id": 0} v 0) -- 0x7f94d8148770 con 0x7f94d80af520 2024-05-09T07:54:13.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.490+0000 7f94c9ffb640 1 -- 172.21.15.110:0/2253004608 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c73afe3-24ba-499d-b59f-d0541e2feef3", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f94d401cc50 con 0x7f94d80af520 2024-05-09T07:54:13.505 INFO:teuthology.orchestra.run.smithi110.stdout:0 2024-05-09T07:54:13.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.491+0000 7f94df7b7640 1 -- 172.21.15.110:0/2253004608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d80af520 msgr2=0x7f94d81e06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.491+0000 7f94df7b7640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d80af520 0x7f94d81e06c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94d400e9b0 tx=0x7f94d400ee70 comp rx=0 tx=0).stop 2024-05-09T07:54:13.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.491+0000 7f94df7b7640 1 -- 172.21.15.110:0/2253004608 shutdown_connections 2024-05-09T07:54:13.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.491+0000 7f94df7b7640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d81444a0 0x7f94d806ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.491+0000 7f94df7b7640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f94d80b5d80 0x7f94d806b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.491+0000 7f94df7b7640 1 --2- 172.21.15.110:0/2253004608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d80af520 0x7f94d81e06c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.491+0000 7f94df7b7640 1 -- 172.21.15.110:0/2253004608 >> 172.21.15.110:0/2253004608 conn(0x7f94d80b69c0 msgr2=0x7f94d80725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:13.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.491+0000 7f94df7b7640 1 -- 172.21.15.110:0/2253004608 shutdown_connections 2024-05-09T07:54:13.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.491+0000 7f94df7b7640 1 -- 172.21.15.110:0/2253004608 wait complete. 2024-05-09T07:54:13.519 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 4ac91ca6-ede6-491f-8b01-252aa53ab8fc 1 2024-05-09T07:54:13.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.603+0000 7f19aba38640 1 Processor -- start 2024-05-09T07:54:13.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.603+0000 7f19aba38640 1 -- start start 2024-05-09T07:54:13.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19aba38640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19a413f530 0x7f19a413f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19aba38640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19a414e010 0x7f19a4150400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19aba38640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19a40b5c30 con 0x7f19a4067200 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19aba38640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f19a4148e50 con 0x7f19a413f530 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19aba38640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f19a413feb0 con 0x7f19a414e010 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19a9fd5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19a414e010 0x7f19a4150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19a9fd5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19a414e010 0x7f19a4150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60226/0 (socket says 172.21.15.110:60226) 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19a9fd5640 1 -- 172.21.15.110:0/2532357222 learned_addr learned my addr 172.21.15.110:0/2532357222 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19a97d4640 1 --1- 172.21.15.110:0/2532357222 >> v1:172.21.15.110:6789/0 conn(0x7f19a4067200 0x7f19a41492e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:59820/0 (socket says 172.21.15.110:59820) 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19a8fd3640 1 --2- 172.21.15.110:0/2532357222 >> v2:172.21.15.87:3300/0 conn(0x7f19a413f530 0x7f19a413f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19a9fd5640 1 -- 172.21.15.110:0/2532357222 >> v2:172.21.15.87:3300/0 conn(0x7f19a413f530 msgr2=0x7f19a413f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19a9fd5640 1 --2- 172.21.15.110:0/2532357222 >> v2:172.21.15.87:3300/0 conn(0x7f19a413f530 0x7f19a413f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19a9fd5640 1 -- 172.21.15.110:0/2532357222 >> v1:172.21.15.110:6789/0 conn(0x7f19a4067200 legacy=0x7f19a41492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f199bfff640 1 -- 172.21.15.110:0/2532357222 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062476877 0 0) 0x7f19a40b5c30 con 0x7f19a4067200 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.604+0000 7f19a9fd5640 1 -- 172.21.15.110:0/2532357222 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a406dbe0 con 0x7f19a414e010 2024-05-09T07:54:13.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.605+0000 7f19a9fd5640 1 --2- 172.21.15.110:0/2532357222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a414e010 0x7f19a4150400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f19a40b3b90 tx=0x7f199c02a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4220bd3fde8b3d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:13.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.605+0000 7f199bfff640 1 -- 172.21.15.110:0/2532357222 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c036070 con 0x7f19a414e010 2024-05-09T07:54:13.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.605+0000 7f199bfff640 1 -- 172.21.15.110:0/2532357222 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199c031600 con 0x7f19a414e010 2024-05-09T07:54:13.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.605+0000 7f199bfff640 1 -- 172.21.15.110:0/2532357222 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c0319d0 con 0x7f19a414e010 2024-05-09T07:54:13.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.605+0000 7f19aba38640 1 -- 172.21.15.110:0/2532357222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a414e010 msgr2=0x7f19a4150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.605+0000 7f19aba38640 1 --2- 172.21.15.110:0/2532357222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a414e010 0x7f19a4150400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f19a40b3b90 tx=0x7f199c02a6a0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.606+0000 7f19aba38640 1 -- 172.21.15.110:0/2532357222 shutdown_connections 2024-05-09T07:54:13.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.606+0000 7f19aba38640 1 --2- 172.21.15.110:0/2532357222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a414e010 0x7f19a4150400 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.606+0000 7f19aba38640 1 --2- 172.21.15.110:0/2532357222 >> v2:172.21.15.87:3300/0 conn(0x7f19a413f530 0x7f19a413f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.606+0000 7f19aba38640 1 -- 172.21.15.110:0/2532357222 >> 172.21.15.110:0/2532357222 conn(0x7f19a40b6020 msgr2=0x7f19a40b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:13.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.606+0000 7f19aba38640 1 -- 172.21.15.110:0/2532357222 shutdown_connections 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.606+0000 7f19aba38640 1 -- 172.21.15.110:0/2532357222 wait complete. 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19aba38640 1 Processor -- start 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19aba38640 1 -- start start 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19aba38640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4067200 0x7f19a413af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19aba38640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a413f530 0x7f19a41de760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19aba38640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a414e010 0x7f19a4137640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19aba38640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40b4c10 con 0x7f19a414e010 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19aba38640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f19a40b4130 con 0x7f19a4067200 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19aba38640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f19a4144c20 con 0x7f19a413f530 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19a97d4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4067200 0x7f19a413af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19a97d4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4067200 0x7f19a413af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60230/0 (socket says 172.21.15.110:60230) 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19a97d4640 1 -- 172.21.15.110:0/2380694699 learned_addr learned my addr 172.21.15.110:0/2380694699 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19a8fd3640 1 --2- 172.21.15.110:0/2380694699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a413f530 0x7f19a41de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.607+0000 7f19a9fd5640 1 --2- 172.21.15.110:0/2380694699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a414e010 0x7f19a4137640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f19a97d4640 1 -- 172.21.15.110:0/2380694699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a413f530 msgr2=0x7f19a41de760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f19a97d4640 1 --2- 172.21.15.110:0/2380694699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a413f530 0x7f19a41de760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f19a97d4640 1 -- 172.21.15.110:0/2380694699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a414e010 msgr2=0x7f19a4137640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f19a97d4640 1 --2- 172.21.15.110:0/2380694699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a414e010 0x7f19a4137640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f19a97d4640 1 -- 172.21.15.110:0/2380694699 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a4146280 con 0x7f19a4067200 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f19a97d4640 1 --2- 172.21.15.110:0/2380694699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4067200 0x7f19a413af10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c500 tx=0x7f19a000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f1999ffb640 1 -- 172.21.15.110:0/2380694699 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0018070 con 0x7f19a4067200 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f1999ffb640 1 -- 172.21.15.110:0/2380694699 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a0007580 con 0x7f19a4067200 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f19aba38640 1 -- 172.21.15.110:0/2380694699 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a4144e70 con 0x7f19a4067200 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f1999ffb640 1 -- 172.21.15.110:0/2380694699 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0004a20 con 0x7f19a4067200 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f19aba38640 1 -- 172.21.15.110:0/2380694699 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a4144990 con 0x7f19a4067200 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f1999ffb640 1 -- 172.21.15.110:0/2380694699 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19a001b070 con 0x7f19a4067200 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.608+0000 7f1999ffb640 1 -- 172.21.15.110:0/2380694699 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f19a00127b0 con 0x7f19a4067200 2024-05-09T07:54:13.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.609+0000 7f19aba38640 1 -- 172.21.15.110:0/2380694699 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a40691f0 con 0x7f19a4067200 2024-05-09T07:54:13.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.611+0000 7f1999ffb640 1 -- 172.21.15.110:0/2380694699 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f19a0004c80 con 0x7f19a4067200 2024-05-09T07:54:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.684+0000 7f19aba38640 1 -- 172.21.15.110:0/2380694699 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4ac91ca6-ede6-491f-8b01-252aa53ab8fc", "id": 1} v 0) -- 0x7f19a4147720 con 0x7f19a4067200 2024-05-09T07:54:13.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.687+0000 7f1999ffb640 1 -- 172.21.15.110:0/2380694699 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ac91ca6-ede6-491f-8b01-252aa53ab8fc", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f19a001d440 con 0x7f19a4067200 2024-05-09T07:54:13.702 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-05-09T07:54:13.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.688+0000 7f19aba38640 1 -- 172.21.15.110:0/2380694699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4067200 msgr2=0x7f19a413af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.688+0000 7f19aba38640 1 --2- 172.21.15.110:0/2380694699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4067200 0x7f19a413af10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c500 tx=0x7f19a000c9c0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.688+0000 7f19aba38640 1 -- 172.21.15.110:0/2380694699 shutdown_connections 2024-05-09T07:54:13.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.688+0000 7f19aba38640 1 --2- 172.21.15.110:0/2380694699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19a413f530 0x7f19a41de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.688+0000 7f19aba38640 1 --2- 172.21.15.110:0/2380694699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a414e010 0x7f19a4137640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.688+0000 7f19aba38640 1 --2- 172.21.15.110:0/2380694699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a4067200 0x7f19a413af10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.688+0000 7f19aba38640 1 -- 172.21.15.110:0/2380694699 >> 172.21.15.110:0/2380694699 conn(0x7f19a40b6020 msgr2=0x7f19a409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:13.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.688+0000 7f19aba38640 1 -- 172.21.15.110:0/2380694699 shutdown_connections 2024-05-09T07:54:13.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.688+0000 7f19aba38640 1 -- 172.21.15.110:0/2380694699 wait complete. 2024-05-09T07:54:13.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 3671dd85-857f-46d2-807a-a4b9f1140197 2 2024-05-09T07:54:13.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.798+0000 7fbeaf561640 1 Processor -- start 2024-05-09T07:54:13.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.798+0000 7fbeaf561640 1 -- start start 2024-05-09T07:54:13.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.798+0000 7fbeaf561640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea806bbb0 0x7fbea809b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.798+0000 7fbeaf561640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbea814af20 0x7fbea8141950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.798+0000 7fbeaf561640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea806bf90 con 0x7fbea8141e90 2024-05-09T07:54:13.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.798+0000 7fbeaf561640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fbea814bcd0 con 0x7fbea814af20 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.798+0000 7fbeaf561640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbea814b680 con 0x7fbea806bbb0 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.798+0000 7fbeacafc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbea814af20 0x7fbea8141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbead2fd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea806bbb0 0x7fbea809b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbeacafc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbea814af20 0x7fbea8141950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60246/0 (socket says 172.21.15.110:60246) 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbead2fd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea806bbb0 0x7fbea809b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43270/0 (socket says 172.21.15.110:43270) 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbeadafe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbea8141e90 0x7fbea8147bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:59834/0 (socket says 172.21.15.110:59834) 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbeacafc640 1 -- 172.21.15.110:0/1953295499 learned_addr learned my addr 172.21.15.110:0/1953295499 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbead2fd640 1 -- 172.21.15.110:0/1953295499 >> v2:172.21.15.110:3300/0 conn(0x7fbea814af20 msgr2=0x7fbea8141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbead2fd640 1 --2- 172.21.15.110:0/1953295499 >> v2:172.21.15.110:3300/0 conn(0x7fbea814af20 0x7fbea8141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbead2fd640 1 -- 172.21.15.110:0/1953295499 >> v1:172.21.15.110:6789/0 conn(0x7fbea8141e90 legacy=0x7fbea8147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbead2fd640 1 -- 172.21.15.110:0/1953295499 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea814b960 con 0x7fbea806bbb0 2024-05-09T07:54:13.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.799+0000 7fbeacafc640 1 --2- 172.21.15.110:0/1953295499 >> v2:172.21.15.110:3300/0 conn(0x7fbea814af20 0x7fbea8141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:13.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbead2fd640 1 --2- 172.21.15.110:0/1953295499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea806bbb0 0x7fbea809b3c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe980097a0 tx=0x7fbe9802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef38eb3946dbd6f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:13.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbe9ffff640 1 -- 172.21.15.110:0/1953295499 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98037070 con 0x7fbea806bbb0 2024-05-09T07:54:13.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbe9ffff640 1 -- 172.21.15.110:0/1953295499 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe98032440 con 0x7fbea806bbb0 2024-05-09T07:54:13.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbe9ffff640 1 -- 172.21.15.110:0/1953295499 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98032810 con 0x7fbea806bbb0 2024-05-09T07:54:13.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbeaf561640 1 -- 172.21.15.110:0/1953295499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea806bbb0 msgr2=0x7fbea809b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbeaf561640 1 --2- 172.21.15.110:0/1953295499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea806bbb0 0x7fbea809b3c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe980097a0 tx=0x7fbe9802a180 comp rx=0 tx=0).stop 2024-05-09T07:54:13.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbeaf561640 1 -- 172.21.15.110:0/1953295499 shutdown_connections 2024-05-09T07:54:13.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbeaf561640 1 --2- 172.21.15.110:0/1953295499 >> v2:172.21.15.110:3300/0 conn(0x7fbea814af20 0x7fbea8141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbeaf561640 1 --2- 172.21.15.110:0/1953295499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea806bbb0 0x7fbea809b3c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbeaf561640 1 -- 172.21.15.110:0/1953295499 >> 172.21.15.110:0/1953295499 conn(0x7fbea8067670 msgr2=0x7fbea806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbeaf561640 1 -- 172.21.15.110:0/1953295499 shutdown_connections 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.800+0000 7fbeaf561640 1 -- 172.21.15.110:0/1953295499 wait complete. 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.801+0000 7fbeaf561640 1 Processor -- start 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.801+0000 7fbeaf561640 1 -- start start 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeaf561640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbea806bbb0 0x7fbea80bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeaf561640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea8141e90 0x7fbea80a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeaf561640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea814af20 0x7fbea81e09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeaf561640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbea8148460 con 0x7fbea814af20 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeaf561640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbea81482e0 con 0x7fbea806bbb0 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeaf561640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbea814a870 con 0x7fbea8141e90 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbead2fd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbea806bbb0 0x7fbea80bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeacafc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea8141e90 0x7fbea80a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbead2fd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbea806bbb0 0x7fbea80bd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60258/0 (socket says 172.21.15.110:60258) 2024-05-09T07:54:13.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbead2fd640 1 -- 172.21.15.110:0/2808801205 learned_addr learned my addr 172.21.15.110:0/2808801205 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeacafc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea8141e90 0x7fbea80a1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43272/0 (socket says 172.21.15.110:43272) 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeadafe640 1 --2- 172.21.15.110:0/2808801205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea814af20 0x7fbea81e09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbead2fd640 1 -- 172.21.15.110:0/2808801205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea8141e90 msgr2=0x7fbea80a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbead2fd640 1 --2- 172.21.15.110:0/2808801205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea8141e90 0x7fbea80a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbead2fd640 1 -- 172.21.15.110:0/2808801205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea814af20 msgr2=0x7fbea81e09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbead2fd640 1 --2- 172.21.15.110:0/2808801205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea814af20 0x7fbea81e09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbead2fd640 1 -- 172.21.15.110:0/2808801205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea80bd250 con 0x7fbea806bbb0 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbeadafe640 1 --2- 172.21.15.110:0/2808801205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea814af20 0x7fbea81e09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.802+0000 7fbead2fd640 1 --2- 172.21.15.110:0/2808801205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbea806bbb0 0x7fbea80bd9e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbe98035040 tx=0x7fbe980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.803+0000 7fbe9dffb640 1 -- 172.21.15.110:0/2808801205 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98037040 con 0x7fbea806bbb0 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.803+0000 7fbe9dffb640 1 -- 172.21.15.110:0/2808801205 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe98030500 con 0x7fbea806bbb0 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.803+0000 7fbe9dffb640 1 -- 172.21.15.110:0/2808801205 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98030910 con 0x7fbea806bbb0 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.803+0000 7fbeaf561640 1 -- 172.21.15.110:0/2808801205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea814a220 con 0x7fbea806bbb0 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.803+0000 7fbeaf561640 1 -- 172.21.15.110:0/2808801205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea80bcf70 con 0x7fbea806bbb0 2024-05-09T07:54:13.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.803+0000 7fbe9dffb640 1 -- 172.21.15.110:0/2808801205 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbe98044020 con 0x7fbea806bbb0 2024-05-09T07:54:13.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.803+0000 7fbe9dffb640 1 -- 172.21.15.110:0/2808801205 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fbe9803d420 con 0x7fbea806bbb0 2024-05-09T07:54:13.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.804+0000 7fbeaf561640 1 -- 172.21.15.110:0/2808801205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea80691f0 con 0x7fbea806bbb0 2024-05-09T07:54:13.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.806+0000 7fbe9dffb640 1 -- 172.21.15.110:0/2808801205 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbe9803bb60 con 0x7fbea806bbb0 2024-05-09T07:54:13.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.899+0000 7fbeaf561640 1 -- 172.21.15.110:0/2808801205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3671dd85-857f-46d2-807a-a4b9f1140197", "id": 2} v 0) -- 0x7fbea8147020 con 0x7fbea806bbb0 2024-05-09T07:54:13.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.904+0000 7fbe9dffb640 1 -- 172.21.15.110:0/2808801205 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3671dd85-857f-46d2-807a-a4b9f1140197", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fbe9803be00 con 0x7fbea806bbb0 2024-05-09T07:54:13.919 INFO:teuthology.orchestra.run.smithi110.stdout:2 2024-05-09T07:54:13.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.905+0000 7fbeaf561640 1 -- 172.21.15.110:0/2808801205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbea806bbb0 msgr2=0x7fbea80bd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:13.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.905+0000 7fbeaf561640 1 --2- 172.21.15.110:0/2808801205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbea806bbb0 0x7fbea80bd9e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbe98035040 tx=0x7fbe980046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.905+0000 7fbeaf561640 1 -- 172.21.15.110:0/2808801205 shutdown_connections 2024-05-09T07:54:13.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.905+0000 7fbeaf561640 1 --2- 172.21.15.110:0/2808801205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbea8141e90 0x7fbea80a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.905+0000 7fbeaf561640 1 --2- 172.21.15.110:0/2808801205 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbea814af20 0x7fbea81e09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.905+0000 7fbeaf561640 1 --2- 172.21.15.110:0/2808801205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbea806bbb0 0x7fbea80bd9e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:13.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.905+0000 7fbeaf561640 1 -- 172.21.15.110:0/2808801205 >> 172.21.15.110:0/2808801205 conn(0x7fbea8067670 msgr2=0x7fbea8074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:13.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.905+0000 7fbeaf561640 1 -- 172.21.15.110:0/2808801205 shutdown_connections 2024-05-09T07:54:13.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:13.905+0000 7fbeaf561640 1 -- 172.21.15.110:0/2808801205 wait complete. 2024-05-09T07:54:13.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 8dbf1cd3-1093-4f15-a332-43ae83f6b0c9 3 2024-05-09T07:54:14.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.015+0000 7f9a4d22a640 1 Processor -- start 2024-05-09T07:54:14.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.016+0000 7f9a4d22a640 1 -- start start 2024-05-09T07:54:14.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a4d22a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a4814ee70 0x7f9a48151260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a4d22a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4806b840 con 0x7f9a48070670 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a4d22a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a480b9960 con 0x7f9a4806b460 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a4d22a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9a48146510 con 0x7f9a4814ee70 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a46d9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9a4806b460 0x7f9a48145e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:59836/0 (socket says 172.21.15.110:59836) 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a46d9d640 1 -- 172.21.15.110:0/2463739985 learned_addr learned my addr 172.21.15.110:0/2463739985 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a4759e640 1 --2- 172.21.15.110:0/2463739985 >> v2:172.21.15.87:3300/0 conn(0x7f9a4814ee70 0x7f9a48151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a45d9b640 1 -- 172.21.15.110:0/2463739985 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699418410 0 0) 0x7f9a480b9960 con 0x7f9a4806b460 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a45d9b640 1 -- 172.21.15.110:0/2463739985 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a34003520 con 0x7f9a4806b460 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a45d9b640 1 -- 172.21.15.110:0/2463739985 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237607552 0 0) 0x7f9a4806b840 con 0x7f9a48070670 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a45d9b640 1 -- 172.21.15.110:0/2463739985 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a480b9960 con 0x7f9a48070670 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a45d9b640 1 -- 172.21.15.110:0/2463739985 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 650048829 0 0) 0x7f9a34003520 con 0x7f9a4806b460 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a4759e640 1 -- 172.21.15.110:0/2463739985 >> v1:172.21.15.110:6789/0 conn(0x7f9a4806b460 legacy=0x7f9a48145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a4759e640 1 -- 172.21.15.110:0/2463739985 >> v1:172.21.15.87:6789/0 conn(0x7f9a48070670 legacy=0x7f9a48072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.017+0000 7f9a4759e640 1 -- 172.21.15.110:0/2463739985 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a48070b90 con 0x7f9a4814ee70 2024-05-09T07:54:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.018+0000 7f9a4759e640 1 --2- 172.21.15.110:0/2463739985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a4814ee70 0x7f9a48151260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009d90 tx=0x7f9a4002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8098bbef548e25c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.018+0000 7f9a45d9b640 1 -- 172.21.15.110:0/2463739985 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38001670 con 0x7f9a4814ee70 2024-05-09T07:54:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.018+0000 7f9a45d9b640 1 -- 172.21.15.110:0/2463739985 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a40007540 con 0x7f9a4814ee70 2024-05-09T07:54:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.018+0000 7f9a45d9b640 1 -- 172.21.15.110:0/2463739985 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a400078f0 con 0x7f9a4814ee70 2024-05-09T07:54:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.019+0000 7f9a4d22a640 1 -- 172.21.15.110:0/2463739985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a4814ee70 msgr2=0x7f9a48151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.019+0000 7f9a4d22a640 1 --2- 172.21.15.110:0/2463739985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a4814ee70 0x7f9a48151260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009d90 tx=0x7f9a4002a610 comp rx=0 tx=0).stop 2024-05-09T07:54:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.019+0000 7f9a4d22a640 1 -- 172.21.15.110:0/2463739985 shutdown_connections 2024-05-09T07:54:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.019+0000 7f9a4d22a640 1 --2- 172.21.15.110:0/2463739985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a4814ee70 0x7f9a48151260 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.019+0000 7f9a4d22a640 1 -- 172.21.15.110:0/2463739985 >> 172.21.15.110:0/2463739985 conn(0x7f9a480b7dc0 msgr2=0x7f9a480b81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.019+0000 7f9a4d22a640 1 -- 172.21.15.110:0/2463739985 shutdown_connections 2024-05-09T07:54:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.019+0000 7f9a4d22a640 1 -- 172.21.15.110:0/2463739985 wait complete. 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.021+0000 7f9a4d22a640 1 Processor -- start 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.021+0000 7f9a4d22a640 1 -- start start 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4d22a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4806b460 0x7f9a4813c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4d22a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a48070670 0x7f9a48141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4d22a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4814ee70 0x7f9a481db630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4d22a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4806ec40 con 0x7f9a48070670 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4d22a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48145920 con 0x7f9a4806b460 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4d22a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4806c140 con 0x7f9a4814ee70 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4814ee70 0x7f9a481db630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a46d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4806b460 0x7f9a4813c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4814ee70 0x7f9a481db630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43274/0 (socket says 172.21.15.110:43274) 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4759e640 1 -- 172.21.15.110:0/3543153945 learned_addr learned my addr 172.21.15.110:0/3543153945 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4659c640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a48070670 0x7f9a48141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4759e640 1 -- 172.21.15.110:0/3543153945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4806b460 msgr2=0x7f9a4813c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4759e640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4806b460 0x7f9a4813c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4759e640 1 -- 172.21.15.110:0/3543153945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a48070670 msgr2=0x7f9a48141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4759e640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a48070670 0x7f9a48141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4759e640 1 -- 172.21.15.110:0/3543153945 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a48141ed0 con 0x7f9a4814ee70 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a46d9d640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4806b460 0x7f9a4813c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4659c640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a48070670 0x7f9a48141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a4759e640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4814ee70 0x7f9a481db630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9a4002ac00 tx=0x7f9a40004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.022+0000 7f9a3f7fe640 1 -- 172.21.15.110:0/3543153945 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40040070 con 0x7f9a4814ee70 2024-05-09T07:54:14.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.023+0000 7f9a3f7fe640 1 -- 172.21.15.110:0/3543153945 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a40031c40 con 0x7f9a4814ee70 2024-05-09T07:54:14.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.023+0000 7f9a4d22a640 1 -- 172.21.15.110:0/3543153945 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a48142150 con 0x7f9a4814ee70 2024-05-09T07:54:14.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.023+0000 7f9a3f7fe640 1 -- 172.21.15.110:0/3543153945 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40009450 con 0x7f9a4814ee70 2024-05-09T07:54:14.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.023+0000 7f9a4d22a640 1 -- 172.21.15.110:0/3543153945 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a48142ba0 con 0x7f9a4814ee70 2024-05-09T07:54:14.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.023+0000 7f9a3f7fe640 1 -- 172.21.15.110:0/3543153945 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9a40039040 con 0x7f9a4814ee70 2024-05-09T07:54:14.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.023+0000 7f9a3f7fe640 1 -- 172.21.15.110:0/3543153945 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f9a400448a0 con 0x7f9a4814ee70 2024-05-09T07:54:14.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.024+0000 7f9a4d22a640 1 -- 172.21.15.110:0/3543153945 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a480691f0 con 0x7f9a4814ee70 2024-05-09T07:54:14.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.026+0000 7f9a3f7fe640 1 -- 172.21.15.110:0/3543153945 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9a48141ed0 con 0x7f9a4814ee70 2024-05-09T07:54:14.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.098+0000 7f9a4d22a640 1 -- 172.21.15.110:0/3543153945 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8dbf1cd3-1093-4f15-a332-43ae83f6b0c9", "id": 3} v 0) -- 0x7f9a48071d00 con 0x7f9a4814ee70 2024-05-09T07:54:14.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.103+0000 7f9a3f7fe640 1 -- 172.21.15.110:0/3543153945 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8dbf1cd3-1093-4f15-a332-43ae83f6b0c9", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9a40044410 con 0x7f9a4814ee70 2024-05-09T07:54:14.118 INFO:teuthology.orchestra.run.smithi110.stdout:3 2024-05-09T07:54:14.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.104+0000 7f9a4d22a640 1 -- 172.21.15.110:0/3543153945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4814ee70 msgr2=0x7f9a481db630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.104+0000 7f9a4d22a640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4814ee70 0x7f9a481db630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9a4002ac00 tx=0x7f9a40004a40 comp rx=0 tx=0).stop 2024-05-09T07:54:14.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.104+0000 7f9a4d22a640 1 -- 172.21.15.110:0/3543153945 shutdown_connections 2024-05-09T07:54:14.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.104+0000 7f9a4d22a640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4814ee70 0x7f9a481db630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.104+0000 7f9a4d22a640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a48070670 0x7f9a48141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.104+0000 7f9a4d22a640 1 --2- 172.21.15.110:0/3543153945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a4806b460 0x7f9a4813c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.104+0000 7f9a4d22a640 1 -- 172.21.15.110:0/3543153945 >> 172.21.15.110:0/3543153945 conn(0x7f9a480b7dc0 msgr2=0x7f9a4806db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.105+0000 7f9a4d22a640 1 -- 172.21.15.110:0/3543153945 shutdown_connections 2024-05-09T07:54:14.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.105+0000 7f9a4d22a640 1 -- 172.21.15.110:0/3543153945 wait complete. 2024-05-09T07:54:14.121 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:14.107+0000 7f6df880e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T07:54:14.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 84871857-3b5d-44d0-b7ce-0ca847641d05 4 2024-05-09T07:54:14.157 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:14.142+0000 7fdf49528040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T07:54:14.215 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:14.200+0000 7f6df880e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T07:54:14.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.215+0000 7fb4b95a0640 1 Processor -- start 2024-05-09T07:54:14.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.215+0000 7fb4b95a0640 1 -- start start 2024-05-09T07:54:14.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b95a0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4b413f1e0 0x7fb4b413f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b95a0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41490d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b95a0640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4b4149610 con 0x7fb4b40b7df0 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b95a0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb4b413fb80 con 0x7fb4b413f1e0 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b95a0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b40b81d0 con 0x7fb4b4148c40 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b8d9f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b37fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4b413f1e0 0x7fb4b413f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b8d9f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43288/0 (socket says 172.21.15.110:43288) 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b37fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4b413f1e0 0x7fb4b413f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60280/0 (socket says 172.21.15.110:60280) 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b8d9f640 1 -- 172.21.15.110:0/1705923339 learned_addr learned my addr 172.21.15.110:0/1705923339 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b3fff640 1 --1- 172.21.15.110:0/1705923339 >> v1:172.21.15.110:6789/0 conn(0x7fb4b40b7df0 0x7fb4b40b5730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:59850/0 (socket says 172.21.15.110:59850) 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b8d9f640 1 -- 172.21.15.110:0/1705923339 >> v2:172.21.15.110:3300/0 conn(0x7fb4b413f1e0 msgr2=0x7fb4b413f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b8d9f640 1 --2- 172.21.15.110:0/1705923339 >> v2:172.21.15.110:3300/0 conn(0x7fb4b413f1e0 0x7fb4b413f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b8d9f640 1 -- 172.21.15.110:0/1705923339 >> v1:172.21.15.110:6789/0 conn(0x7fb4b40b7df0 legacy=0x7fb4b40b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b8d9f640 1 -- 172.21.15.110:0/1705923339 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b40b6c50 con 0x7fb4b4148c40 2024-05-09T07:54:14.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.216+0000 7fb4b37fe640 1 --2- 172.21.15.110:0/1705923339 >> v2:172.21.15.110:3300/0 conn(0x7fb4b413f1e0 0x7fb4b413f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:14.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.217+0000 7fb4b8d9f640 1 --2- 172.21.15.110:0/1705923339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41490d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009e50 tx=0x7fb4ac02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dba515a9f7d1b2ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.217+0000 7fb4b2ffd640 1 -- 172.21.15.110:0/1705923339 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac036070 con 0x7fb4b4148c40 2024-05-09T07:54:14.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.217+0000 7fb4b2ffd640 1 -- 172.21.15.110:0/1705923339 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ac031600 con 0x7fb4b4148c40 2024-05-09T07:54:14.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.217+0000 7fb4b2ffd640 1 -- 172.21.15.110:0/1705923339 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0319d0 con 0x7fb4b4148c40 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.218+0000 7fb4b95a0640 1 -- 172.21.15.110:0/1705923339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 msgr2=0x7fb4b41490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.218+0000 7fb4b95a0640 1 --2- 172.21.15.110:0/1705923339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41490d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009e50 tx=0x7fb4ac02a680 comp rx=0 tx=0).stop 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.218+0000 7fb4b95a0640 1 -- 172.21.15.110:0/1705923339 shutdown_connections 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.218+0000 7fb4b95a0640 1 --2- 172.21.15.110:0/1705923339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41490d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.218+0000 7fb4b95a0640 1 --2- 172.21.15.110:0/1705923339 >> v2:172.21.15.110:3300/0 conn(0x7fb4b413f1e0 0x7fb4b413f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.218+0000 7fb4b95a0640 1 -- 172.21.15.110:0/1705923339 >> 172.21.15.110:0/1705923339 conn(0x7fb4b406b3d0 msgr2=0x7fb4b406b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.218+0000 7fb4b95a0640 1 -- 172.21.15.110:0/1705923339 shutdown_connections 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.218+0000 7fb4b95a0640 1 -- 172.21.15.110:0/1705923339 wait complete. 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.219+0000 7fb4b95a0640 1 Processor -- start 2024-05-09T07:54:14.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.219+0000 7fb4b95a0640 1 -- start start 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.219+0000 7fb4b95a0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4b40b7df0 0x7fb4b4145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.219+0000 7fb4b95a0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b413f1e0 0x7fb4b412fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.219+0000 7fb4b95a0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41d4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.219+0000 7fb4b95a0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b40730c0 con 0x7fb4b40b7df0 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.219+0000 7fb4b95a0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b40b7210 con 0x7fb4b413f1e0 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.219+0000 7fb4b95a0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b414fcd0 con 0x7fb4b4148c40 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b413f1e0 0x7fb4b412fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b8d9f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41d4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b413f1e0 0x7fb4b412fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60290/0 (socket says 172.21.15.110:60290) 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b37fe640 1 -- 172.21.15.110:0/4066181592 learned_addr learned my addr 172.21.15.110:0/4066181592 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b3fff640 1 --2- 172.21.15.110:0/4066181592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4b40b7df0 0x7fb4b4145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b37fe640 1 -- 172.21.15.110:0/4066181592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 msgr2=0x7fb4b41d4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b37fe640 1 --2- 172.21.15.110:0/4066181592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41d4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.237 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b37fe640 1 -- 172.21.15.110:0/4066181592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4b40b7df0 msgr2=0x7fb4b4145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b37fe640 1 --2- 172.21.15.110:0/4066181592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4b40b7df0 0x7fb4b4145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b37fe640 1 -- 172.21.15.110:0/4066181592 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b41d5560 con 0x7fb4b413f1e0 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b8d9f640 1 --2- 172.21.15.110:0/4066181592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41d4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b37fe640 1 --2- 172.21.15.110:0/4066181592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b413f1e0 0x7fb4b412fc50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00ec10 tx=0x7fb49c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b0ff9640 1 -- 172.21.15.110:0/4066181592 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c017070 con 0x7fb4b413f1e0 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b0ff9640 1 -- 172.21.15.110:0/4066181592 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49c00cc30 con 0x7fb4b413f1e0 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b95a0640 1 -- 172.21.15.110:0/4066181592 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b41d5840 con 0x7fb4b413f1e0 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b0ff9640 1 -- 172.21.15.110:0/4066181592 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49c013470 con 0x7fb4b413f1e0 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b95a0640 1 -- 172.21.15.110:0/4066181592 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b41d50a0 con 0x7fb4b413f1e0 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b0ff9640 1 -- 172.21.15.110:0/4066181592 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb49c01a070 con 0x7fb4b413f1e0 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.220+0000 7fb4b0ff9640 1 -- 172.21.15.110:0/4066181592 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb49c01ca00 con 0x7fb4b413f1e0 2024-05-09T07:54:14.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.221+0000 7fb4b95a0640 1 -- 172.21.15.110:0/4066181592 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b413f000 con 0x7fb4b413f1e0 2024-05-09T07:54:14.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.223+0000 7fb4b0ff9640 1 -- 172.21.15.110:0/4066181592 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb4b413f000 con 0x7fb4b413f1e0 2024-05-09T07:54:14.243 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:14.228+0000 7fdf49528040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T07:54:14.260 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:14.246+0000 7f6df880e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T07:54:14.285 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:14.270+0000 7fdf49528040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T07:54:14.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.296+0000 7fb4b95a0640 1 -- 172.21.15.110:0/4066181592 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "84871857-3b5d-44d0-b7ce-0ca847641d05", "id": 4} v 0) -- 0x7fb4b40756c0 con 0x7fb4b413f1e0 2024-05-09T07:54:14.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.302+0000 7fb4b0ff9640 1 -- 172.21.15.110:0/4066181592 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84871857-3b5d-44d0-b7ce-0ca847641d05", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb49c01cca0 con 0x7fb4b413f1e0 2024-05-09T07:54:14.317 INFO:teuthology.orchestra.run.smithi110.stdout:4 2024-05-09T07:54:14.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.303+0000 7fb4b95a0640 1 -- 172.21.15.110:0/4066181592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b413f1e0 msgr2=0x7fb4b412fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.303+0000 7fb4b95a0640 1 --2- 172.21.15.110:0/4066181592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b413f1e0 0x7fb4b412fc50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00ec10 tx=0x7fb49c00c520 comp rx=0 tx=0).stop 2024-05-09T07:54:14.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.303+0000 7fb4b95a0640 1 -- 172.21.15.110:0/4066181592 shutdown_connections 2024-05-09T07:54:14.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.303+0000 7fb4b95a0640 1 --2- 172.21.15.110:0/4066181592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4b4148c40 0x7fb4b41d4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.303+0000 7fb4b95a0640 1 --2- 172.21.15.110:0/4066181592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4b413f1e0 0x7fb4b412fc50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.303+0000 7fb4b95a0640 1 --2- 172.21.15.110:0/4066181592 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4b40b7df0 0x7fb4b4145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.303+0000 7fb4b95a0640 1 -- 172.21.15.110:0/4066181592 >> 172.21.15.110:0/4066181592 conn(0x7fb4b406b3d0 msgr2=0x7fb4b40b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.303+0000 7fb4b95a0640 1 -- 172.21.15.110:0/4066181592 shutdown_connections 2024-05-09T07:54:14.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.303+0000 7fb4b95a0640 1 -- 172.21.15.110:0/4066181592 wait complete. 2024-05-09T07:54:14.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 26198799-f42a-46f6-a18b-02d10eda294f 5 2024-05-09T07:54:14.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.413+0000 7fe6ebbd5640 1 Processor -- start 2024-05-09T07:54:14.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.413+0000 7fe6ebbd5640 1 -- start start 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ebbd5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6e4148440 0x7fe6e414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ebbd5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e40afeb0 con 0x7fe6e40aeee0 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ebbd5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e40b0160 con 0x7fe6e40afad0 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ebbd5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e40b0440 con 0x7fe6e4148440 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ea172640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6e4148440 0x7fe6e414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ea172640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6e4148440 0x7fe6e414fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60302/0 (socket says 172.21.15.110:60302) 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ea172640 1 -- 172.21.15.110:0/962247108 learned_addr learned my addr 172.21.15.110:0/962247108 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ea172640 1 -- 172.21.15.110:0/962247108 >> v1:172.21.15.110:6789/0 conn(0x7fe6e40afad0 legacy=0x7fe6e413e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ea172640 1 -- 172.21.15.110:0/962247108 >> v1:172.21.15.87:6789/0 conn(0x7fe6e40aeee0 legacy=0x7fe6e4147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6e896f640 1 -- 172.21.15.110:0/962247108 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851234757 0 0) 0x7fe6e40b0160 con 0x7fe6e40afad0 2024-05-09T07:54:14.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.414+0000 7fe6ea172640 1 -- 172.21.15.110:0/962247108 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e40b98f0 con 0x7fe6e4148440 2024-05-09T07:54:14.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.415+0000 7fe6ea172640 1 --2- 172.21.15.110:0/962247108 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e4148440 0x7fe6e414fdf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009e50 tx=0x7fe6dc02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cd087d509cbaef7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.415+0000 7fe6e896f640 1 -- 172.21.15.110:0/962247108 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc036070 con 0x7fe6e4148440 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.415+0000 7fe6e896f640 1 -- 172.21.15.110:0/962247108 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc031600 con 0x7fe6e4148440 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.415+0000 7fe6e896f640 1 -- 172.21.15.110:0/962247108 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0319d0 con 0x7fe6e4148440 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.415+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/962247108 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e4148440 msgr2=0x7fe6e414fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.415+0000 7fe6ebbd5640 1 --2- 172.21.15.110:0/962247108 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e4148440 0x7fe6e414fdf0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009e50 tx=0x7fe6dc02a730 comp rx=0 tx=0).stop 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.416+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/962247108 shutdown_connections 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.416+0000 7fe6ebbd5640 1 --2- 172.21.15.110:0/962247108 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e4148440 0x7fe6e414fdf0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.416+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/962247108 >> 172.21.15.110:0/962247108 conn(0x7fe6e40b7dc0 msgr2=0x7fe6e40b81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.416+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/962247108 shutdown_connections 2024-05-09T07:54:14.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.416+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/962247108 wait complete. 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6ebbd5640 1 Processor -- start 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6ebbd5640 1 -- start start 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6ebbd5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e40aeee0 0x7fe6e41467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6ebbd5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40afad0 0x7fe6e4136680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6ebbd5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6e4148440 0x7fe6e4136bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6ebbd5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e40af490 con 0x7fe6e40afad0 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6ebbd5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e40af310 con 0x7fe6e40aeee0 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6ebbd5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e40af610 con 0x7fe6e4148440 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6e9971640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e40aeee0 0x7fe6e41467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6ea172640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6e4148440 0x7fe6e4136bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6e9971640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e40aeee0 0x7fe6e41467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60310/0 (socket says 172.21.15.110:60310) 2024-05-09T07:54:14.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6e9971640 1 -- 172.21.15.110:0/3875698968 learned_addr learned my addr 172.21.15.110:0/3875698968 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.417+0000 7fe6e9170640 1 --2- 172.21.15.110:0/3875698968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40afad0 0x7fe6e4136680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6ea172640 1 -- 172.21.15.110:0/3875698968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e40aeee0 msgr2=0x7fe6e41467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6ea172640 1 --2- 172.21.15.110:0/3875698968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e40aeee0 0x7fe6e41467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6ea172640 1 -- 172.21.15.110:0/3875698968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40afad0 msgr2=0x7fe6e4136680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6ea172640 1 --2- 172.21.15.110:0/3875698968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40afad0 0x7fe6e4136680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6ea172640 1 -- 172.21.15.110:0/3875698968 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e413f710 con 0x7fe6e4148440 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6e9971640 1 --2- 172.21.15.110:0/3875698968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e40aeee0 0x7fe6e41467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6ea172640 1 --2- 172.21.15.110:0/3875698968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6e4148440 0x7fe6e4136bc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6e406fd70 tx=0x7fe6dc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6da7fc640 1 -- 172.21.15.110:0/3875698968 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc036050 con 0x7fe6e4148440 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6da7fc640 1 -- 172.21.15.110:0/3875698968 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc042070 con 0x7fe6e4148440 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/3875698968 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e4140490 con 0x7fe6e4148440 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6da7fc640 1 -- 172.21.15.110:0/3875698968 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc009510 con 0x7fe6e4148440 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/3875698968 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e4145980 con 0x7fe6e4148440 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6da7fc640 1 -- 172.21.15.110:0/3875698968 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe6dc007b70 con 0x7fe6e4148440 2024-05-09T07:54:14.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.418+0000 7fe6da7fc640 1 -- 172.21.15.110:0/3875698968 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe6dc047b30 con 0x7fe6e4148440 2024-05-09T07:54:14.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.419+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/3875698968 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e40691f0 con 0x7fe6e4148440 2024-05-09T07:54:14.436 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:14.422+0000 7f6df880e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T07:54:14.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.423+0000 7fe6da7fc640 1 -- 172.21.15.110:0/3875698968 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe6dc047460 con 0x7fe6e4148440 2024-05-09T07:54:14.448 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:14.434+0000 7fdf49528040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T07:54:14.494 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:14.479+0000 7f6df880e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T07:54:14.499 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:14.484+0000 7fdf49528040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T07:54:14.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.495+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/3875698968 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "26198799-f42a-46f6-a18b-02d10eda294f", "id": 5} v 0) -- 0x7fe6e409fd10 con 0x7fe6e4148440 2024-05-09T07:54:14.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.500+0000 7fe6da7fc640 1 -- 172.21.15.110:0/3875698968 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26198799-f42a-46f6-a18b-02d10eda294f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe6dc047640 con 0x7fe6e4148440 2024-05-09T07:54:14.515 INFO:teuthology.orchestra.run.smithi110.stdout:5 2024-05-09T07:54:14.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.501+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/3875698968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6e4148440 msgr2=0x7fe6e4136bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.501+0000 7fe6ebbd5640 1 --2- 172.21.15.110:0/3875698968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6e4148440 0x7fe6e4136bc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6e406fd70 tx=0x7fe6dc004a40 comp rx=0 tx=0).stop 2024-05-09T07:54:14.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.501+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/3875698968 shutdown_connections 2024-05-09T07:54:14.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.501+0000 7fe6ebbd5640 1 --2- 172.21.15.110:0/3875698968 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6e4148440 0x7fe6e4136bc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.501+0000 7fe6ebbd5640 1 --2- 172.21.15.110:0/3875698968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6e40afad0 0x7fe6e4136680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.501+0000 7fe6ebbd5640 1 --2- 172.21.15.110:0/3875698968 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6e40aeee0 0x7fe6e41467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.501+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/3875698968 >> 172.21.15.110:0/3875698968 conn(0x7fe6e40b7dc0 msgr2=0x7fe6e40b81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.501+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/3875698968 shutdown_connections 2024-05-09T07:54:14.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.501+0000 7fe6ebbd5640 1 -- 172.21.15.110:0/3875698968 wait complete. 2024-05-09T07:54:14.526 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 3250b67e-2980-4f93-ac34-4ef4b1f3da18 6 2024-05-09T07:54:14.550 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:14.536+0000 7f6df880e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T07:54:14.551 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:14.536+0000 7fdf49528040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T07:54:14.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.611+0000 7fe1c44e1640 1 Processor -- start 2024-05-09T07:54:14.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.611+0000 7fe1c44e1640 1 -- start start 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c44e1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe1bc1417b0 0x7fe1bc141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c44e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc148160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c44e1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1bc0b4780 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c44e1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe1bc142150 con 0x7fe1bc1417b0 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c44e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe1bc1486a0 con 0x7fe1bc147cf0 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c1a7c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe1bc1417b0 0x7fe1bc141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c2a7e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c1a7c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe1bc1417b0 0x7fe1bc141c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60312/0 (socket says 172.21.15.110:60312) 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c1a7c640 1 -- 172.21.15.110:0/421635365 learned_addr learned my addr 172.21.15.110:0/421635365 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c1a7c640 1 -- 172.21.15.110:0/421635365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 msgr2=0x7fe1bc148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c1a7c640 1 --2- 172.21.15.110:0/421635365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c1a7c640 1 -- 172.21.15.110:0/421635365 >> v1:172.21.15.110:6789/0 conn(0x7fe1bc0b4dd0 legacy=0x7fe1bc0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c1a7c640 1 -- 172.21.15.110:0/421635365 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc0b5e20 con 0x7fe1bc1417b0 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c127b640 1 -- 172.21.15.110:0/421635365 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307763868 0 0) 0x7fe1bc0b4780 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.612+0000 7fe1c2a7e640 1 --2- 172.21.15.110:0/421635365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.613+0000 7fe1c1a7c640 1 --2- 172.21.15.110:0/421635365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc1417b0 0x7fe1bc141c10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009870 tx=0x7fe1ac02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5db84bb36604231e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.613+0000 7fe1c127b640 1 -- 172.21.15.110:0/421635365 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac037070 con 0x7fe1bc1417b0 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.613+0000 7fe1c127b640 1 -- 172.21.15.110:0/421635365 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ac032440 con 0x7fe1bc1417b0 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.613+0000 7fe1c127b640 1 -- 172.21.15.110:0/421635365 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac032810 con 0x7fe1bc1417b0 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.614+0000 7fe1c44e1640 1 -- 172.21.15.110:0/421635365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc1417b0 msgr2=0x7fe1bc141c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.614+0000 7fe1c44e1640 1 --2- 172.21.15.110:0/421635365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc1417b0 0x7fe1bc141c10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009870 tx=0x7fe1ac02a1c0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.614+0000 7fe1c44e1640 1 -- 172.21.15.110:0/421635365 shutdown_connections 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.614+0000 7fe1c44e1640 1 --2- 172.21.15.110:0/421635365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.614+0000 7fe1c44e1640 1 --2- 172.21.15.110:0/421635365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc1417b0 0x7fe1bc141c10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.614+0000 7fe1c44e1640 1 -- 172.21.15.110:0/421635365 >> 172.21.15.110:0/421635365 conn(0x7fe1bc0677b0 msgr2=0x7fe1bc0bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.614+0000 7fe1c44e1640 1 -- 172.21.15.110:0/421635365 shutdown_connections 2024-05-09T07:54:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.614+0000 7fe1c44e1640 1 -- 172.21.15.110:0/421635365 wait complete. 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.615+0000 7fe1c44e1640 1 Processor -- start 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.615+0000 7fe1c44e1640 1 -- start start 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.615+0000 7fe1c44e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc0b4dd0 0x7fe1bc1ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.615+0000 7fe1c44e1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc1417b0 0x7fe1bc1cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.615+0000 7fe1c44e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.615+0000 7fe1c44e1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc0b4080 con 0x7fe1bc1417b0 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.615+0000 7fe1c44e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc0b6370 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.615+0000 7fe1c44e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe1bc0b4200 con 0x7fe1bc147cf0 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c2a7e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c2a7e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc142500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43310/0 (socket says 172.21.15.110:43310) 2024-05-09T07:54:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c2a7e640 1 -- 172.21.15.110:0/41226408 learned_addr learned my addr 172.21.15.110:0/41226408 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c227d640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc0b4dd0 0x7fe1bc1ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c1a7c640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc1417b0 0x7fe1bc1cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c227d640 1 -- 172.21.15.110:0/41226408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 msgr2=0x7fe1bc142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c227d640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c227d640 1 -- 172.21.15.110:0/41226408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc1417b0 msgr2=0x7fe1bc1cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c227d640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc1417b0 0x7fe1bc1cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c227d640 1 -- 172.21.15.110:0/41226408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc1cfc00 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c2a7e640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c1a7c640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc1417b0 0x7fe1bc1cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c227d640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc0b4dd0 0x7fe1bc1ce200 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c480 tx=0x7fe1b800c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1b2ffd640 1 -- 172.21.15.110:0/41226408 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8017070 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1b2ffd640 1 -- 172.21.15.110:0/41226408 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b8005480 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c44e1640 1 -- 172.21.15.110:0/41226408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc144fa0 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1b2ffd640 1 -- 172.21.15.110:0/41226408 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8003830 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1c44e1640 1 -- 172.21.15.110:0/41226408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc144200 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1b2ffd640 1 -- 172.21.15.110:0/41226408 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe1b801a070 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.616+0000 7fe1b2ffd640 1 -- 172.21.15.110:0/41226408 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe1b80129f0 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.617+0000 7fe1c44e1640 1 -- 172.21.15.110:0/41226408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1bc144dc0 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.619+0000 7fe1b2ffd640 1 -- 172.21.15.110:0/41226408 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe1bc144dc0 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.661 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:14.647+0000 7fdf49528040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T07:54:14.669 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:14.654+0000 7f6df880e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T07:54:14.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.692+0000 7fe1c44e1640 1 -- 172.21.15.110:0/41226408 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3250b67e-2980-4f93-ac34-4ef4b1f3da18", "id": 6} v 0) -- 0x7fe1bc0691f0 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.700+0000 7fe1b2ffd640 1 -- 172.21.15.110:0/41226408 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3250b67e-2980-4f93-ac34-4ef4b1f3da18", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe1b8021020 con 0x7fe1bc0b4dd0 2024-05-09T07:54:14.714 INFO:teuthology.orchestra.run.smithi110.stdout:6 2024-05-09T07:54:14.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.700+0000 7fe1c44e1640 1 -- 172.21.15.110:0/41226408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc0b4dd0 msgr2=0x7fe1bc1ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.700+0000 7fe1c44e1640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc0b4dd0 0x7fe1bc1ce200 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800c480 tx=0x7fe1b800c940 comp rx=0 tx=0).stop 2024-05-09T07:54:14.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.700+0000 7fe1c44e1640 1 -- 172.21.15.110:0/41226408 shutdown_connections 2024-05-09T07:54:14.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.700+0000 7fe1c44e1640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1bc147cf0 0x7fe1bc142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.700+0000 7fe1c44e1640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe1bc1417b0 0x7fe1bc1cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.700+0000 7fe1c44e1640 1 --2- 172.21.15.110:0/41226408 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1bc0b4dd0 0x7fe1bc1ce200 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.700+0000 7fe1c44e1640 1 -- 172.21.15.110:0/41226408 >> 172.21.15.110:0/41226408 conn(0x7fe1bc0677b0 msgr2=0x7fe1bc0b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.701+0000 7fe1c44e1640 1 -- 172.21.15.110:0/41226408 shutdown_connections 2024-05-09T07:54:14.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.701+0000 7fe1c44e1640 1 -- 172.21.15.110:0/41226408 wait complete. 2024-05-09T07:54:14.725 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new a6f75777-0493-473d-9a0c-fb138f27cd80 7 2024-05-09T07:54:14.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.850+0000 7fa047215640 1 Processor -- start 2024-05-09T07:54:14.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.850+0000 7fa047215640 1 -- start start 2024-05-09T07:54:14.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa047215640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa0400af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa047215640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa040148760 0x7fa040152240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa047215640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa04006e790 con 0x7fa0400afd30 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa047215640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa04006bb20 con 0x7fa040148760 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa047215640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa04006d710 con 0x7fa04006e3b0 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa044fb1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa0400af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa044fb1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa0400af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43314/0 (socket says 172.21.15.110:43314) 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa044fb1640 1 -- 172.21.15.110:0/2669947324 learned_addr learned my addr 172.21.15.110:0/2669947324 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa0457b2640 1 --2- 172.21.15.110:0/2669947324 >> v2:172.21.15.87:3300/0 conn(0x7fa040148760 0x7fa040152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa044fb1640 1 -- 172.21.15.110:0/2669947324 >> v2:172.21.15.87:3300/0 conn(0x7fa040148760 msgr2=0x7fa040152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa044fb1640 1 --2- 172.21.15.110:0/2669947324 >> v2:172.21.15.87:3300/0 conn(0x7fa040148760 0x7fa040152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa044fb1640 1 -- 172.21.15.110:0/2669947324 >> v1:172.21.15.87:6789/0 conn(0x7fa0400afd30 legacy=0x7fa040148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.851+0000 7fa044fb1640 1 -- 172.21.15.110:0/2669947324 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04006d430 con 0x7fa04006e3b0 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.852+0000 7fa044fb1640 1 --2- 172.21.15.110:0/2669947324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa0400af7f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa034009870 tx=0x7fa03402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9551ddf28e3fa44e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.852+0000 7fa03f7fe640 1 -- 172.21.15.110:0/2669947324 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034037070 con 0x7fa04006e3b0 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.852+0000 7fa03f7fe640 1 -- 172.21.15.110:0/2669947324 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa034032440 con 0x7fa04006e3b0 2024-05-09T07:54:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.852+0000 7fa03f7fe640 1 -- 172.21.15.110:0/2669947324 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034032810 con 0x7fa04006e3b0 2024-05-09T07:54:14.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.853+0000 7fa047215640 1 -- 172.21.15.110:0/2669947324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 msgr2=0x7fa0400af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.853+0000 7fa047215640 1 --2- 172.21.15.110:0/2669947324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa0400af7f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa034009870 tx=0x7fa03402a1c0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.853+0000 7fa047215640 1 -- 172.21.15.110:0/2669947324 shutdown_connections 2024-05-09T07:54:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.853+0000 7fa047215640 1 --2- 172.21.15.110:0/2669947324 >> v2:172.21.15.87:3300/0 conn(0x7fa040148760 0x7fa040152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.853+0000 7fa047215640 1 --2- 172.21.15.110:0/2669947324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa0400af7f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.853+0000 7fa047215640 1 -- 172.21.15.110:0/2669947324 >> 172.21.15.110:0/2669947324 conn(0x7fa0400b7dc0 msgr2=0x7fa0400b81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.853+0000 7fa047215640 1 -- 172.21.15.110:0/2669947324 shutdown_connections 2024-05-09T07:54:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.853+0000 7fa047215640 1 -- 172.21.15.110:0/2669947324 wait complete. 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.854+0000 7fa047215640 1 Processor -- start 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.854+0000 7fa047215640 1 -- start start 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.854+0000 7fa047215640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa040146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.854+0000 7fa047215640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0400afd30 0x7fa0401ddca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.854+0000 7fa047215640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa040148760 0x7fa04013d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.854+0000 7fa047215640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa04006b600 con 0x7fa040148760 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.854+0000 7fa047215640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa0400af080 con 0x7fa0400afd30 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.854+0000 7fa047215640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa04006c1d0 con 0x7fa04006e3b0 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.854+0000 7fa044fb1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa040146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa044fb1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa040146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:43316/0 (socket says 172.21.15.110:43316) 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa044fb1640 1 -- 172.21.15.110:0/3710789060 learned_addr learned my addr 172.21.15.110:0/3710789060 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa03ffff640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0400afd30 0x7fa0401ddca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa0457b2640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa040148760 0x7fa04013d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa044fb1640 1 -- 172.21.15.110:0/3710789060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0400afd30 msgr2=0x7fa0401ddca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa044fb1640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0400afd30 0x7fa0401ddca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa044fb1640 1 -- 172.21.15.110:0/3710789060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa040148760 msgr2=0x7fa04013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa044fb1640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa040148760 0x7fa04013d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa044fb1640 1 -- 172.21.15.110:0/3710789060 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04013e320 con 0x7fa04006e3b0 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa03ffff640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0400afd30 0x7fa0401ddca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa044fb1640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa040146620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa034000c00 tx=0x7fa0340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa03d7fa640 1 -- 172.21.15.110:0/3710789060 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034041020 con 0x7fa04006e3b0 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa03d7fa640 1 -- 172.21.15.110:0/3710789060 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0340306c0 con 0x7fa04006e3b0 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa03d7fa640 1 -- 172.21.15.110:0/3710789060 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034037040 con 0x7fa04006e3b0 2024-05-09T07:54:14.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa047215640 1 -- 172.21.15.110:0/3710789060 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0401dd780 con 0x7fa04006e3b0 2024-05-09T07:54:14.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa047215640 1 -- 172.21.15.110:0/3710789060 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0401e09c0 con 0x7fa04006e3b0 2024-05-09T07:54:14.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa03d7fa640 1 -- 172.21.15.110:0/3710789060 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa034044020 con 0x7fa04006e3b0 2024-05-09T07:54:14.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.855+0000 7fa03d7fa640 1 -- 172.21.15.110:0/3710789060 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa03403dc90 con 0x7fa04006e3b0 2024-05-09T07:54:14.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.856+0000 7fa047215640 1 -- 172.21.15.110:0/3710789060 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0400691f0 con 0x7fa04006e3b0 2024-05-09T07:54:14.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.858+0000 7fa03d7fa640 1 -- 172.21.15.110:0/3710789060 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa03404b030 con 0x7fa04006e3b0 2024-05-09T07:54:14.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.931+0000 7fa047215640 1 -- 172.21.15.110:0/3710789060 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a6f75777-0493-473d-9a0c-fb138f27cd80", "id": 7} v 0) -- 0x7fa04006dd10 con 0x7fa04006e3b0 2024-05-09T07:54:14.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.936+0000 7fa03d7fa640 1 -- 172.21.15.110:0/3710789060 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6f75777-0493-473d-9a0c-fb138f27cd80", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa03403d420 con 0x7fa04006e3b0 2024-05-09T07:54:14.950 INFO:teuthology.orchestra.run.smithi110.stdout:7 2024-05-09T07:54:14.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.937+0000 7fa047215640 1 -- 172.21.15.110:0/3710789060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 msgr2=0x7fa040146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:14.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.937+0000 7fa047215640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa040146620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa034000c00 tx=0x7fa0340046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.937+0000 7fa047215640 1 -- 172.21.15.110:0/3710789060 shutdown_connections 2024-05-09T07:54:14.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.937+0000 7fa047215640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa040148760 0x7fa04013d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.937+0000 7fa047215640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0400afd30 0x7fa0401ddca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.937+0000 7fa047215640 1 --2- 172.21.15.110:0/3710789060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa04006e3b0 0x7fa040146620 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:14.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.937+0000 7fa047215640 1 -- 172.21.15.110:0/3710789060 >> 172.21.15.110:0/3710789060 conn(0x7fa0400b7dc0 msgr2=0x7fa040143480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:14.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.937+0000 7fa047215640 1 -- 172.21.15.110:0/3710789060 shutdown_connections 2024-05-09T07:54:14.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-05-09T07:54:14.937+0000 7fa047215640 1 -- 172.21.15.110:0/3710789060 wait complete. 2024-05-09T07:54:14.962 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-09T07:54:14.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-09T07:54:14.964 INFO:tasks.ceph.osd.0:Started 2024-05-09T07:54:14.965 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-09T07:54:14.965 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-09T07:54:14.968 INFO:tasks.ceph.osd.1:Started 2024-05-09T07:54:14.969 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-09T07:54:14.969 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-09T07:54:14.971 INFO:tasks.ceph.osd.2:Started 2024-05-09T07:54:14.971 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-09T07:54:14.971 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-09T07:54:14.973 INFO:tasks.ceph.osd.3:Started 2024-05-09T07:54:14.973 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-09T07:54:14.973 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-09T07:54:14.975 INFO:tasks.ceph.osd.4:Started 2024-05-09T07:54:14.976 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-09T07:54:14.976 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-09T07:54:14.978 INFO:tasks.ceph.osd.5:Started 2024-05-09T07:54:14.978 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-09T07:54:14.978 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-09T07:54:14.980 INFO:tasks.ceph.osd.6:Started 2024-05-09T07:54:14.980 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-09T07:54:14.980 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-09T07:54:14.983 INFO:tasks.ceph.osd.7:Started 2024-05-09T07:54:14.984 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:15.065 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:15.051+0000 7fdf49528040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T07:54:15.092 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:15.077+0000 7f6df880e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T07:54:15.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.099+0000 7f630fa12640 1 Processor -- start 2024-05-09T07:54:15.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630fa12640 1 -- start start 2024-05-09T07:54:15.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630fa12640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b5e20 0x7f6308147720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:15.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630fa12640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6308141c90 0x7f6308152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:15.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630fa12640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63080b5900 con 0x7f63080b3e30 2024-05-09T07:54:15.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630fa12640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f63080b50c0 con 0x7f6308141c90 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630fa12640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f63080b4a70 con 0x7f63080b5e20 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630cfad640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f63080b3e30 0x7f6308141580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34738/0 (socket says 172.21.15.87:34738) 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630cfad640 1 -- 172.21.15.87:0/2845633657 learned_addr learned my addr 172.21.15.87:0/2845633657 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630d7ae640 1 --2- 172.21.15.87:0/2845633657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b5e20 0x7f6308147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.100+0000 7f630dfaf640 1 --2- 172.21.15.87:0/2845633657 >> v2:172.21.15.110:3300/0 conn(0x7f6308141c90 0x7f6308152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.101+0000 7f62fffff640 1 -- 172.21.15.87:0/2845633657 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3122520310 0 0) 0x7f63080b5900 con 0x7f63080b3e30 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.101+0000 7f62fffff640 1 -- 172.21.15.87:0/2845633657 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f4003520 con 0x7f63080b3e30 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.101+0000 7f630dfaf640 1 -- 172.21.15.87:0/2845633657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b5e20 msgr2=0x7f6308147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.101+0000 7f62fffff640 1 -- 172.21.15.87:0/2845633657 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2264897565 0 0) 0x7f62f4003520 con 0x7f63080b3e30 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.101+0000 7f630dfaf640 1 --2- 172.21.15.87:0/2845633657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b5e20 0x7f6308147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.101+0000 7f630dfaf640 1 -- 172.21.15.87:0/2845633657 >> v1:172.21.15.87:6789/0 conn(0x7f63080b3e30 legacy=0x7f6308141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.101+0000 7f630dfaf640 1 -- 172.21.15.87:0/2845633657 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63080b4d50 con 0x7f6308141c90 2024-05-09T07:54:15.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.101+0000 7f630d7ae640 1 --2- 172.21.15.87:0/2845633657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b5e20 0x7f6308147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f630dfaf640 1 --2- 172.21.15.87:0/2845633657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308141c90 0x7f6308152080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6300009d90 tx=0x7f630002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbfd265d81d25142 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f62fffff640 1 -- 172.21.15.87:0/2845633657 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304001670 con 0x7f6308141c90 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f62fffff640 1 -- 172.21.15.87:0/2845633657 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6300007540 con 0x7f6308141c90 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f62fffff640 1 -- 172.21.15.87:0/2845633657 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300007910 con 0x7f6308141c90 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f630fa12640 1 -- 172.21.15.87:0/2845633657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308141c90 msgr2=0x7f6308152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f630fa12640 1 --2- 172.21.15.87:0/2845633657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308141c90 0x7f6308152080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6300009d90 tx=0x7f630002a5f0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f630fa12640 1 -- 172.21.15.87:0/2845633657 shutdown_connections 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f630fa12640 1 --2- 172.21.15.87:0/2845633657 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6308141c90 0x7f6308152080 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f630fa12640 1 --2- 172.21.15.87:0/2845633657 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63080b5e20 0x7f6308147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.102+0000 7f630fa12640 1 -- 172.21.15.87:0/2845633657 >> 172.21.15.87:0/2845633657 conn(0x7f63080676a0 msgr2=0x7f63080bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.103+0000 7f630fa12640 1 -- 172.21.15.87:0/2845633657 shutdown_connections 2024-05-09T07:54:15.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.103+0000 7f630fa12640 1 -- 172.21.15.87:0/2845633657 wait complete. 2024-05-09T07:54:15.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.103+0000 7f630fa12640 1 Processor -- start 2024-05-09T07:54:15.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630fa12640 1 -- start start 2024-05-09T07:54:15.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630fa12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63080b3e30 0x7f6308143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630fa12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63080b5e20 0x7f63081e0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630fa12640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6308141c90 0x7f63081e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630fa12640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f63080b5550 con 0x7f63080b5e20 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630fa12640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f63080bdbc0 con 0x7f63080b3e30 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630fa12640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f63081428e0 con 0x7f6308141c90 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630cfad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63080b5e20 0x7f63081e0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630cfad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63080b5e20 0x7f63081e0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41174/0 (socket says 172.21.15.87:41174) 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630d7ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63080b3e30 0x7f6308143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630dfaf640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6308141c90 0x7f63081e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.104+0000 7f630cfad640 1 -- 172.21.15.87:0/4203223398 learned_addr learned my addr 172.21.15.87:0/4203223398 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f630d7ae640 1 -- 172.21.15.87:0/4203223398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6308141c90 msgr2=0x7f63081e0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f630d7ae640 1 --2- 172.21.15.87:0/4203223398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6308141c90 0x7f63081e0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f630d7ae640 1 -- 172.21.15.87:0/4203223398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63080b5e20 msgr2=0x7f63081e0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f630d7ae640 1 --2- 172.21.15.87:0/4203223398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63080b5e20 0x7f63081e0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f630d7ae640 1 -- 172.21.15.87:0/4203223398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6308142b30 con 0x7f63080b3e30 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f630d7ae640 1 --2- 172.21.15.87:0/4203223398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63080b3e30 0x7f6308143960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f62f800e930 tx=0x7f62f800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f62fdffb640 1 -- 172.21.15.87:0/4203223398 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f800ca00 con 0x7f63080b3e30 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f62fdffb640 1 -- 172.21.15.87:0/4203223398 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f800cba0 con 0x7f63080b3e30 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f630fa12640 1 -- 172.21.15.87:0/4203223398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6308144180 con 0x7f63080b3e30 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f62fdffb640 1 -- 172.21.15.87:0/4203223398 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8005990 con 0x7f63080b3e30 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f62fdffb640 1 -- 172.21.15.87:0/4203223398 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f62f8006030 con 0x7f63080b3e30 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f630fa12640 1 -- 172.21.15.87:0/4203223398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63081e1360 con 0x7f63080b3e30 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.105+0000 7f62fdffb640 1 -- 172.21.15.87:0/4203223398 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f62f8013470 con 0x7f63080b3e30 2024-05-09T07:54:15.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.106+0000 7f630fa12640 1 -- 172.21.15.87:0/4203223398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630814ba00 con 0x7f63080b3e30 2024-05-09T07:54:15.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.108+0000 7f62fdffb640 1 -- 172.21.15.87:0/4203223398 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f62f8017020 con 0x7f63080b3e30 2024-05-09T07:54:15.182 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.168+0000 7f630fa12640 1 -- 172.21.15.87:0/4203223398 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63080691f0 con 0x7f63080b3e30 2024-05-09T07:54:15.183 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.168+0000 7f62fdffb640 1 -- 172.21.15.87:0/4203223398 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f62f8006500 con 0x7f63080b3e30 2024-05-09T07:54:15.184 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:15.184 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":10,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:14.932728+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:15.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.169+0000 7f630fa12640 1 -- 172.21.15.87:0/4203223398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63080b3e30 msgr2=0x7f6308143960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:15.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.169+0000 7f630fa12640 1 --2- 172.21.15.87:0/4203223398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63080b3e30 0x7f6308143960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f62f800e930 tx=0x7f62f800edf0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.169+0000 7f630fa12640 1 -- 172.21.15.87:0/4203223398 shutdown_connections 2024-05-09T07:54:15.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.169+0000 7f630fa12640 1 --2- 172.21.15.87:0/4203223398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6308141c90 0x7f63081e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.185 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.169+0000 7f630fa12640 1 --2- 172.21.15.87:0/4203223398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63080b5e20 0x7f63081e0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.169+0000 7f630fa12640 1 --2- 172.21.15.87:0/4203223398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63080b3e30 0x7f6308143960 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:15.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.169+0000 7f630fa12640 1 -- 172.21.15.87:0/4203223398 >> 172.21.15.87:0/4203223398 conn(0x7f63080676a0 msgr2=0x7f6308140920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:15.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.169+0000 7f630fa12640 1 -- 172.21.15.87:0/4203223398 shutdown_connections 2024-05-09T07:54:15.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:15.169+0000 7f630fa12640 1 -- 172.21.15.87:0/4203223398 wait complete. 2024-05-09T07:54:15.195 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-09T07:54:15.195 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-09T07:54:15.333 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:15.319+0000 7fdf49528040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T07:54:15.351 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:15.337+0000 7f6df880e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T07:54:15.386 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:15.372+0000 7fdf49528040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T07:54:15.404 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:15.390+0000 7f6df880e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T07:54:15.501 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:15.486+0000 7fdf49528040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T07:54:15.520 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:15.506+0000 7f6df880e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T07:54:15.568 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-05-09T07:54:15.553+0000 7f83840e5640 -1 Falling back to public interface 2024-05-09T07:54:15.577 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-09T07:54:15.563+0000 7fbdce914640 -1 Falling back to public interface 2024-05-09T07:54:15.581 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-05-09T07:54:15.566+0000 7f00cb3c0640 -1 Falling back to public interface 2024-05-09T07:54:15.585 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-05-09T07:54:15.570+0000 7f7623682640 -1 Falling back to public interface 2024-05-09T07:54:15.592 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-05-09T07:54:15.577+0000 7f54b4e1c640 -1 Falling back to public interface 2024-05-09T07:54:15.594 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-05-09T07:54:15.579+0000 7f6199526640 -1 Falling back to public interface 2024-05-09T07:54:15.600 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-09T07:54:15.585+0000 7f5ec77b6640 -1 Falling back to public interface 2024-05-09T07:54:15.606 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-09T07:54:15.592+0000 7f39d8744640 -1 Falling back to public interface 2024-05-09T07:54:15.792 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:15.778+0000 7fdf49528040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T07:54:15.825 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:15.810+0000 7f6df880e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T07:54:15.839 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:15.825+0000 7fdf49528040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T07:54:15.874 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:15.859+0000 7f6df880e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T07:54:15.995 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:15.981+0000 7fdf49528040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T07:54:16.000 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:16.028 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:16.013+0000 7f6df880e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T07:54:16.091 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.077+0000 7f41be1ee640 1 Processor -- start 2024-05-09T07:54:16.092 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.077+0000 7f41be1ee640 1 -- start start 2024-05-09T07:54:16.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41be1ee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b806e660 0x7f41b809f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:16.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41be1ee640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41b814afc0 0x7f41b806b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:16.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41be1ee640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41b806ea40 con 0x7f41b814b400 2024-05-09T07:54:16.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41be1ee640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f41b80b1130 con 0x7f41b814afc0 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41be1ee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f41b80b5770 con 0x7f41b806e660 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41b6ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41b814afc0 0x7f41b806b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41b6ffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f41b814afc0 0x7f41b806b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41184/0 (socket says 172.21.15.87:41184) 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41b6ffd640 1 -- 172.21.15.87:0/2701740926 learned_addr learned my addr 172.21.15.87:0/2701740926 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41b77fe640 1 --2- 172.21.15.87:0/2701740926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b806e660 0x7f41b809f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41b6ffd640 1 -- 172.21.15.87:0/2701740926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b806e660 msgr2=0x7f41b809f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41b6ffd640 1 --2- 172.21.15.87:0/2701740926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b806e660 0x7f41b809f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41b6ffd640 1 -- 172.21.15.87:0/2701740926 >> v1:172.21.15.110:6789/0 conn(0x7f41b814b400 legacy=0x7f41b806b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.078+0000 7f41b6ffd640 1 -- 172.21.15.87:0/2701740926 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b80af140 con 0x7f41b814afc0 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41b6ffd640 1 --2- 172.21.15.87:0/2701740926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 0x7f41b806b210 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009870 tx=0x7f41a002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53b888d5a18a87e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41b67fc640 1 -- 172.21.15.87:0/2701740926 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0037070 con 0x7f41b814afc0 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41b67fc640 1 -- 172.21.15.87:0/2701740926 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a0032440 con 0x7f41b814afc0 2024-05-09T07:54:16.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41b67fc640 1 -- 172.21.15.87:0/2701740926 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0032810 con 0x7f41b814afc0 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41be1ee640 1 -- 172.21.15.87:0/2701740926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 msgr2=0x7f41b806b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41be1ee640 1 --2- 172.21.15.87:0/2701740926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 0x7f41b806b210 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009870 tx=0x7f41a002a1c0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41be1ee640 1 -- 172.21.15.87:0/2701740926 shutdown_connections 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41be1ee640 1 --2- 172.21.15.87:0/2701740926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 0x7f41b806b210 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41be1ee640 1 --2- 172.21.15.87:0/2701740926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b806e660 0x7f41b809f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.079+0000 7f41be1ee640 1 -- 172.21.15.87:0/2701740926 >> 172.21.15.87:0/2701740926 conn(0x7f41b80b69d0 msgr2=0x7f41b80b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.080+0000 7f41be1ee640 1 -- 172.21.15.87:0/2701740926 shutdown_connections 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.080+0000 7f41be1ee640 1 -- 172.21.15.87:0/2701740926 wait complete. 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41be1ee640 1 Processor -- start 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41be1ee640 1 -- start start 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41be1ee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41b806e660 0x7f41b81dceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:16.098 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41be1ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 0x7f41b8071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41be1ee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b814b400 0x7f41b8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41be1ee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f41b80b5c00 con 0x7f41b814afc0 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41be1ee640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f41b809fe00 con 0x7f41b806e660 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41be1ee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f41b80b1470 con 0x7f41b814b400 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 0x7f41b8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41b6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 0x7f41b8071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:41194/0 (socket says 172.21.15.87:41194) 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41b6ffd640 1 -- 172.21.15.87:0/3411278138 learned_addr learned my addr 172.21.15.87:0/3411278138 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41b77fe640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41b806e660 0x7f41b81dceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.081+0000 7f41b7fff640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b814b400 0x7f41b8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41b6ffd640 1 -- 172.21.15.87:0/3411278138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b814b400 msgr2=0x7f41b8070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41b6ffd640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b814b400 0x7f41b8070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41b6ffd640 1 -- 172.21.15.87:0/3411278138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41b806e660 msgr2=0x7f41b81dceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41b6ffd640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41b806e660 0x7f41b81dceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.099 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41b6ffd640 1 -- 172.21.15.87:0/3411278138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b80b2350 con 0x7f41b814afc0 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41b7fff640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b814b400 0x7f41b8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41b6ffd640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 0x7f41b8071610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41a002a200 tx=0x7f41a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41affff640 1 -- 172.21.15.87:0/3411278138 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0037040 con 0x7f41b814afc0 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41affff640 1 -- 172.21.15.87:0/3411278138 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a0042070 con 0x7f41b814afc0 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41be1ee640 1 -- 172.21.15.87:0/3411278138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b8072210 con 0x7f41b814afc0 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41affff640 1 -- 172.21.15.87:0/3411278138 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0030880 con 0x7f41b814afc0 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41be1ee640 1 -- 172.21.15.87:0/3411278138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b8148cd0 con 0x7f41b814afc0 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41affff640 1 -- 172.21.15.87:0/3411278138 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f41a002ad10 con 0x7f41b814afc0 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.082+0000 7f41affff640 1 -- 172.21.15.87:0/3411278138 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f41a003b430 con 0x7f41b814afc0 2024-05-09T07:54:16.100 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.083+0000 7f41be1ee640 1 -- 172.21.15.87:0/3411278138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b804f5f0 con 0x7f41b814afc0 2024-05-09T07:54:16.101 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.087+0000 7f41affff640 1 -- 172.21.15.87:0/3411278138 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f41a0047460 con 0x7f41b814afc0 2024-05-09T07:54:16.138 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:16.124+0000 7fdf49528040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T07:54:16.162 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.148+0000 7f41be1ee640 1 -- 172.21.15.87:0/3411278138 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41b8073270 con 0x7f41b814afc0 2024-05-09T07:54:16.163 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.149+0000 7f41affff640 1 -- 172.21.15.87:0/3411278138 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f41a0030a20 con 0x7f41b814afc0 2024-05-09T07:54:16.164 INFO:teuthology.misc.health.smithi087.stdout: 2024-05-09T07:54:16.164 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":10,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:14.932728+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:16.165 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.150+0000 7f41be1ee640 1 -- 172.21.15.87:0/3411278138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 msgr2=0x7f41b8071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:16.165 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.150+0000 7f41be1ee640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 0x7f41b8071610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f41a002a200 tx=0x7f41a00046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.165 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.150+0000 7f41be1ee640 1 -- 172.21.15.87:0/3411278138 shutdown_connections 2024-05-09T07:54:16.165 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.150+0000 7f41be1ee640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41b814b400 0x7f41b8070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.165 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.150+0000 7f41be1ee640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f41b814afc0 0x7f41b8071610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.165 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.150+0000 7f41be1ee640 1 --2- 172.21.15.87:0/3411278138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41b806e660 0x7f41b81dceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:16.165 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.150+0000 7f41be1ee640 1 -- 172.21.15.87:0/3411278138 >> 172.21.15.87:0/3411278138 conn(0x7f41b80b69d0 msgr2=0x7f41b806db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:16.165 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.150+0000 7f41be1ee640 1 -- 172.21.15.87:0/3411278138 shutdown_connections 2024-05-09T07:54:16.166 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:16.150+0000 7f41be1ee640 1 -- 172.21.15.87:0/3411278138 wait complete. 2024-05-09T07:54:16.166 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:16.151+0000 7f6df880e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T07:54:16.176 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-09T07:54:16.192 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:16.177+0000 7fdf49528040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T07:54:16.215 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:16.200+0000 7f6df880e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T07:54:16.261 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:16.247+0000 7fdf49528040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T07:54:16.284 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:16.270+0000 7f6df880e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T07:54:16.305 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:16.291+0000 7fdf49528040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T07:54:16.330 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:16.315+0000 7f6df880e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T07:54:16.781 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:16.766+0000 7fdf49528040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T07:54:16.805 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:16.790+0000 7f6df880e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T07:54:16.893 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:16.879+0000 7fdf49528040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T07:54:16.921 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-05-09T07:54:16.906+0000 7f6df880e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T07:54:17.908 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:17.894+0000 7fdeea050640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T07:54:17.909 INFO:tasks.ceph.mgr.y.smithi087.stderr:2024-05-09T07:54:17.894+0000 7fdeea050640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T07:54:19.022 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-05-09T07:54:19.008+0000 7f83840e5640 -1 osd.0 0 log_to_monitors true 2024-05-09T07:54:19.033 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-05-09T07:54:19.019+0000 7f7623682640 -1 osd.6 0 log_to_monitors true 2024-05-09T07:54:19.078 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-05-09T07:54:19.064+0000 7f00cb3c0640 -1 osd.5 0 log_to_monitors true 2024-05-09T07:54:19.085 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-09T07:54:19.071+0000 7fbdce914640 -1 osd.1 0 log_to_monitors true 2024-05-09T07:54:19.100 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-09T07:54:19.086+0000 7f5ec77b6640 -1 osd.2 0 log_to_monitors true 2024-05-09T07:54:19.103 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-05-09T07:54:19.089+0000 7f6199526640 -1 osd.4 0 log_to_monitors true 2024-05-09T07:54:19.104 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-05-09T07:54:19.090+0000 7f54b4e1c640 -1 osd.7 0 log_to_monitors true 2024-05-09T07:54:19.120 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-09T07:54:19.106+0000 7f39d8744640 -1 osd.3 0 log_to_monitors true 2024-05-09T07:54:22.228 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-05-09T07:54:22.214+0000 7f761edf5640 -1 osd.6 0 waiting for initial osdmap 2024-05-09T07:54:22.242 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-05-09T07:54:22.224+0000 7f7617427640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T07:54:22.317 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-05-09T07:54:22.302+0000 7f6194c99640 -1 osd.4 0 waiting for initial osdmap 2024-05-09T07:54:22.319 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-05-09T07:54:22.304+0000 7f54aff7d640 -1 osd.7 0 waiting for initial osdmap 2024-05-09T07:54:22.321 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-05-09T07:54:22.306+0000 7f00c6b33640 -1 osd.5 0 waiting for initial osdmap 2024-05-09T07:54:22.330 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-05-09T07:54:22.316+0000 7f618d2cb640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T07:54:22.330 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-05-09T07:54:22.316+0000 7f54a85af640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T07:54:22.335 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-05-09T07:54:22.321+0000 7f00bf165640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T07:54:22.965 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-09T07:54:22.950+0000 7f5ec2f29640 -1 osd.2 0 waiting for initial osdmap 2024-05-09T07:54:22.975 INFO:tasks.ceph.osd.2.smithi087.stderr:2024-05-09T07:54:22.960+0000 7f5ebb55b640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T07:54:22.983 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:22.989 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-09T07:54:22.973+0000 7f39d3eb7640 -1 osd.3 0 waiting for initial osdmap 2024-05-09T07:54:23.002 INFO:tasks.ceph.osd.3.smithi087.stderr:2024-05-09T07:54:22.987+0000 7f39cc4e9640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T07:54:23.026 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-09T07:54:23.010+0000 7fbdca087640 -1 osd.1 0 waiting for initial osdmap 2024-05-09T07:54:23.039 INFO:tasks.ceph.osd.1.smithi087.stderr:2024-05-09T07:54:23.024+0000 7fbdc26b9640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T07:54:23.057 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-05-09T07:54:23.042+0000 7f837f858640 -1 osd.0 0 waiting for initial osdmap 2024-05-09T07:54:23.073 INFO:tasks.ceph.osd.0.smithi087.stderr:2024-05-09T07:54:23.058+0000 7f8377e8a640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T07:54:23.085 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.069+0000 7f0ee86ba640 1 Processor -- start 2024-05-09T07:54:23.085 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.069+0000 7f0ee86ba640 1 -- start start 2024-05-09T07:54:23.087 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.070+0000 7f0ee86ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0ee006db40 0x7f0ee009a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.070+0000 7f0ee86ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee0145df0 0x7f0ee0146250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.070+0000 7f0ee86ba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ee00b51e0 0x7f0ee00b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.070+0000 7f0ee86ba640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee006df20 con 0x7f0ee00b51e0 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.070+0000 7f0ee86ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee0145680 con 0x7f0ee006db40 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.070+0000 7f0ee86ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee0072af0 con 0x7f0ee0145df0 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.070+0000 7f0ee6c57640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ee00b51e0 0x7f0ee00b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.070+0000 7f0ee6c57640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0ee00b51e0 0x7f0ee00b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56332/0 (socket says 172.21.15.87:56332) 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.070+0000 7f0ee6c57640 1 -- 172.21.15.87:0/3388263831 learned_addr learned my addr 172.21.15.87:0/3388263831 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.071+0000 7f0ee6456640 1 --2- 172.21.15.87:0/3388263831 >> v2:172.21.15.110:3300/0 conn(0x7f0ee006db40 0x7f0ee009a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.071+0000 7f0ee5c55640 1 --2- 172.21.15.87:0/3388263831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee0145df0 0x7f0ee0146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.071+0000 7f0ee6c57640 1 -- 172.21.15.87:0/3388263831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee0145df0 msgr2=0x7f0ee0146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.071+0000 7f0ee6c57640 1 --2- 172.21.15.87:0/3388263831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee0145df0 0x7f0ee0146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.071+0000 7f0ee6c57640 1 -- 172.21.15.87:0/3388263831 >> v2:172.21.15.110:3300/0 conn(0x7f0ee006db40 msgr2=0x7f0ee009a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:23.088 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.071+0000 7f0ee6c57640 1 --2- 172.21.15.87:0/3388263831 >> v2:172.21.15.110:3300/0 conn(0x7f0ee006db40 0x7f0ee009a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.071+0000 7f0ee6c57640 1 -- 172.21.15.87:0/3388263831 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee0072dd0 con 0x7f0ee00b51e0 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.071+0000 7f0ee6456640 1 --2- 172.21.15.87:0/3388263831 >> v2:172.21.15.110:3300/0 conn(0x7f0ee006db40 0x7f0ee009a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.071+0000 7f0ee6c57640 1 --2- 172.21.15.87:0/3388263831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 0x7f0ee00b5670 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ee006c250 tx=0x7f0ed802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c512f26129850dad server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee5454640 1 -- 172.21.15.87:0/3388263831 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8036070 con 0x7f0ee00b51e0 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee5454640 1 -- 172.21.15.87:0/3388263831 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed8031600 con 0x7f0ee00b51e0 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee5454640 1 -- 172.21.15.87:0/3388263831 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80319d0 con 0x7f0ee00b51e0 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee86ba640 1 -- 172.21.15.87:0/3388263831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 msgr2=0x7f0ee00b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/3388263831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 0x7f0ee00b5670 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ee006c250 tx=0x7f0ed802a6a0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee86ba640 1 -- 172.21.15.87:0/3388263831 shutdown_connections 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/3388263831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 0x7f0ee00b5670 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/3388263831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee0145df0 0x7f0ee0146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/3388263831 >> v2:172.21.15.110:3300/0 conn(0x7f0ee006db40 0x7f0ee009a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee86ba640 1 -- 172.21.15.87:0/3388263831 >> 172.21.15.87:0/3388263831 conn(0x7f0ee00ba280 msgr2=0x7f0ee00ba690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee86ba640 1 -- 172.21.15.87:0/3388263831 shutdown_connections 2024-05-09T07:54:23.089 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.072+0000 7f0ee86ba640 1 -- 172.21.15.87:0/3388263831 wait complete. 2024-05-09T07:54:23.092 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.073+0000 7f0ee86ba640 1 Processor -- start 2024-05-09T07:54:23.092 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.073+0000 7f0ee86ba640 1 -- start start 2024-05-09T07:54:23.092 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee86ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee006db40 0x7f0ee0149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:23.092 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee86ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 0x7f0ee0147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:23.092 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee86ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee0145df0 0x7f0ee01d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:23.092 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee86ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee00b5be0 con 0x7f0ee00b51e0 2024-05-09T07:54:23.092 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee86ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee009af20 con 0x7f0ee0145df0 2024-05-09T07:54:23.092 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee86ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee00b5d60 con 0x7f0ee006db40 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee5c55640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 0x7f0ee0147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee5c55640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 0x7f0ee0147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56338/0 (socket says 172.21.15.87:56338) 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee5c55640 1 -- 172.21.15.87:0/318857064 learned_addr learned my addr 172.21.15.87:0/318857064 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee6456640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee006db40 0x7f0ee0149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee6c57640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee0145df0 0x7f0ee01d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee5c55640 1 -- 172.21.15.87:0/318857064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee006db40 msgr2=0x7f0ee0149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee5c55640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee006db40 0x7f0ee0149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee5c55640 1 -- 172.21.15.87:0/318857064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee0145df0 msgr2=0x7f0ee01d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee5c55640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee0145df0 0x7f0ee01d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee5c55640 1 -- 172.21.15.87:0/318857064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee01484a0 con 0x7f0ee00b51e0 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee5c55640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 0x7f0ee0147f60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c820 tx=0x7f0ed000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ed6ffd640 1 -- 172.21.15.87:0/318857064 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0015070 con 0x7f0ee00b51e0 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ed6ffd640 1 -- 172.21.15.87:0/318857064 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed0004240 con 0x7f0ee00b51e0 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee0147380 con 0x7f0ee00b51e0 2024-05-09T07:54:23.093 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ed6ffd640 1 -- 172.21.15.87:0/318857064 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed000ce10 con 0x7f0ee00b51e0 2024-05-09T07:54:23.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.074+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee0149920 con 0x7f0ee00b51e0 2024-05-09T07:54:23.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.075+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee0149720 con 0x7f0ee00b51e0 2024-05-09T07:54:23.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.076+0000 7f0ed6ffd640 1 -- 172.21.15.87:0/318857064 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f0ed0007830 con 0x7f0ee00b51e0 2024-05-09T07:54:23.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.076+0000 7f0ed6ffd640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f0ec406bda0 0x7f0ec406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:23.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.076+0000 7f0ee6456640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f0ec406bda0 0x7f0ec406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:23.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.076+0000 7f0ed6ffd640 1 -- 172.21.15.87:0/318857064 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3911+0+0 (secure 0 0 0) 0x7f0ed008a370 con 0x7f0ee00b51e0 2024-05-09T07:54:23.094 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.077+0000 7f0ee6456640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f0ec406bda0 0x7f0ec406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0edc006fd0 tx=0x7f0edc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:23.096 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.081+0000 7f0ed6ffd640 1 -- 172.21.15.87:0/318857064 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0ee01484a0 con 0x7f0ee00b51e0 2024-05-09T07:54:23.272 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.255+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ee004f5f0 con 0x7f0ee00b51e0 2024-05-09T07:54:23.272 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.256+0000 7f0ed6ffd640 1 -- 172.21.15.87:0/318857064 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+9937 (secure 0 0 0) 0x7f0ed0058f40 con 0x7f0ee00b51e0 2024-05-09T07:54:23.272 INFO:teuthology.misc.health.smithi087.stdout: 2024-05-09T07:54:23.272 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":13,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:23.023398+0000","last_up_change":"2024-05-09T07:54:23.023398+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:23.274 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f0ec406bda0 msgr2=0x7f0ec406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:23.274 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f0ec406bda0 0x7f0ec406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0edc006fd0 tx=0x7f0edc008040 comp rx=0 tx=0).stop 2024-05-09T07:54:23.274 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 msgr2=0x7f0ee0147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:23.274 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 0x7f0ee0147f60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c820 tx=0x7f0ed000cce0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.274 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 shutdown_connections 2024-05-09T07:54:23.274 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f0ec406bda0 0x7f0ec406e260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.274 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee0145df0 0x7f0ee01d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.274 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ee00b51e0 0x7f0ee0147f60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.274 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 --2- 172.21.15.87:0/318857064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee006db40 0x7f0ee0149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:23.275 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 >> 172.21.15.87:0/318857064 conn(0x7f0ee00ba280 msgr2=0x7f0ee00b8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:23.275 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 shutdown_connections 2024-05-09T07:54:23.275 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:23.258+0000 7f0ee86ba640 1 -- 172.21.15.87:0/318857064 wait complete. 2024-05-09T07:54:23.283 DEBUG:teuthology.misc:6 of 8 OSDs are up 2024-05-09T07:54:30.091 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:30.192 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.177+0000 7f3b9c6ee640 1 Processor -- start 2024-05-09T07:54:30.193 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.177+0000 7f3b9c6ee640 1 -- start start 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b9c6ee640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3b9406bb90 0x7f3b9409e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b9c6ee640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b940adf00 0x7f3b9409ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b9c6ee640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b940b5440 con 0x7f3b94144620 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b9c6ee640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3b9406bf70 con 0x7f3b940adf00 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b9c6ee640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3b940ae9a0 con 0x7f3b9406bb90 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b99c89640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b940adf00 0x7f3b9409ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b99c89640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3b940adf00 0x7f3b9409ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56380/0 (socket says 172.21.15.87:56380) 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b99c89640 1 -- 172.21.15.87:0/1294591043 learned_addr learned my addr 172.21.15.87:0/1294591043 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b99c89640 1 -- 172.21.15.87:0/1294591043 >> v2:172.21.15.110:3300/0 conn(0x7f3b9406bb90 msgr2=0x7f3b9409e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b9a48a640 1 --2- 172.21.15.87:0/1294591043 >> v2:172.21.15.110:3300/0 conn(0x7f3b9406bb90 0x7f3b9409e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.196 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b99c89640 1 --2- 172.21.15.87:0/1294591043 >> v2:172.21.15.110:3300/0 conn(0x7f3b9406bb90 0x7f3b9409e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b99c89640 1 -- 172.21.15.87:0/1294591043 >> v1:172.21.15.110:6789/0 conn(0x7f3b94144620 legacy=0x7f3b94144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b99c89640 1 -- 172.21.15.87:0/1294591043 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b940aec60 con 0x7f3b940adf00 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.178+0000 7f3b9a48a640 1 --2- 172.21.15.87:0/1294591043 >> v2:172.21.15.110:3300/0 conn(0x7f3b9406bb90 0x7f3b9409e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.179+0000 7f3b99c89640 1 --2- 172.21.15.87:0/1294591043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b940adf00 0x7f3b9409ebe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b9406dfb0 tx=0x7f3b8402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742c470b3d292b3c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.179+0000 7f3b99488640 1 -- 172.21.15.87:0/1294591043 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b84037070 con 0x7f3b940adf00 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.179+0000 7f3b99488640 1 -- 172.21.15.87:0/1294591043 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b84032440 con 0x7f3b940adf00 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.179+0000 7f3b99488640 1 -- 172.21.15.87:0/1294591043 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b84032810 con 0x7f3b940adf00 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.180+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1294591043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b940adf00 msgr2=0x7f3b9409ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.180+0000 7f3b9c6ee640 1 --2- 172.21.15.87:0/1294591043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b940adf00 0x7f3b9409ebe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3b9406dfb0 tx=0x7f3b8402a1a0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.180+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1294591043 shutdown_connections 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.180+0000 7f3b9c6ee640 1 --2- 172.21.15.87:0/1294591043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b940adf00 0x7f3b9409ebe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.180+0000 7f3b9c6ee640 1 --2- 172.21.15.87:0/1294591043 >> v2:172.21.15.110:3300/0 conn(0x7f3b9406bb90 0x7f3b9409e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.197 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.180+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1294591043 >> 172.21.15.87:0/1294591043 conn(0x7f3b940b9580 msgr2=0x7f3b9406b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:30.198 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.180+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1294591043 shutdown_connections 2024-05-09T07:54:30.198 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.180+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1294591043 wait complete. 2024-05-09T07:54:30.201 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.181+0000 7f3b9c6ee640 1 Processor -- start 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.181+0000 7f3b9c6ee640 1 -- start start 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.181+0000 7f3b9c6ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b9406bb90 0x7f3b941de820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.181+0000 7f3b9c6ee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b940adf00 0x7f3b940b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.181+0000 7f3b9c6ee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b94144620 0x7f3b9413acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.181+0000 7f3b9c6ee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940b4d00 con 0x7f3b9406bb90 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.181+0000 7f3b9c6ee640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940b4b80 con 0x7f3b94144620 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.181+0000 7f3b9c6ee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3b9409be20 con 0x7f3b940adf00 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.181+0000 7f3b9a48a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b9406bb90 0x7f3b941de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9a48a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b9406bb90 0x7f3b941de820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56394/0 (socket says 172.21.15.87:56394) 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9a48a640 1 -- 172.21.15.87:0/1766819169 learned_addr learned my addr 172.21.15.87:0/1766819169 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9a48a640 1 -- 172.21.15.87:0/1766819169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b940adf00 msgr2=0x7f3b940b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.202 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9ac8b640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b94144620 0x7f3b9413acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9a48a640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b940adf00 0x7f3b940b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9a48a640 1 -- 172.21.15.87:0/1766819169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b94144620 msgr2=0x7f3b9413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9a48a640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b94144620 0x7f3b9413acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9a48a640 1 -- 172.21.15.87:0/1766819169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b94072340 con 0x7f3b9406bb90 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9ac8b640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b94144620 0x7f3b9413acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9a48a640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b9406bb90 0x7f3b941de820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c7f0 tx=0x7f3b9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b8affd640 1 -- 172.21.15.87:0/1766819169 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90015070 con 0x7f3b9406bb90 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b8affd640 1 -- 172.21.15.87:0/1766819169 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b90007a30 con 0x7f3b9406bb90 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b94071bd0 con 0x7f3b9406bb90 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b8affd640 1 -- 172.21.15.87:0/1766819169 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90007e00 con 0x7f3b9406bb90 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.182+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b94072620 con 0x7f3b9406bb90 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.183+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b940ae790 con 0x7f3b9406bb90 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.184+0000 7f3b8affd640 1 -- 172.21.15.87:0/1766819169 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b90018070 con 0x7f3b9406bb90 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.184+0000 7f3b8affd640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3b7806be30 0x7f3b7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.184+0000 7f3b8affd640 1 -- 172.21.15.87:0/1766819169 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3b9008aa90 con 0x7f3b9406bb90 2024-05-09T07:54:30.203 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.184+0000 7f3b99c89640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3b7806be30 0x7f3b7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.204 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.184+0000 7f3b99c89640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3b7806be30 0x7f3b7806e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b84034000 tx=0x7f3b8402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:30.204 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.189+0000 7f3b8affd640 1 -- 172.21.15.87:0/1766819169 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3b940ae790 con 0x7f3b9406bb90 2024-05-09T07:54:30.377 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.362+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b94068660 con 0x7f3b9406bb90 2024-05-09T07:54:30.378 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.363+0000 7f3b8affd640 1 -- 172.21.15.87:0/1766819169 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7f3b94068660 con 0x7f3b9406bb90 2024-05-09T07:54:30.378 INFO:teuthology.misc.health.smithi087.stdout: 2024-05-09T07:54:30.378 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":17,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:27.058535+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3b7806be30 msgr2=0x7f3b7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3b7806be30 0x7f3b7806e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b84034000 tx=0x7f3b8402c000 comp rx=0 tx=0).stop 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b9406bb90 msgr2=0x7f3b941de820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b9406bb90 0x7f3b941de820 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c7f0 tx=0x7f3b9000cbf0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 shutdown_connections 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3b7806be30 0x7f3b7806e2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b940adf00 0x7f3b940b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b94144620 0x7f3b9413acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 --2- 172.21.15.87:0/1766819169 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3b9406bb90 0x7f3b941de820 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 >> 172.21.15.87:0/1766819169 conn(0x7f3b940b9580 msgr2=0x7f3b9409b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 shutdown_connections 2024-05-09T07:54:30.381 INFO:teuthology.misc.health.smithi087.stderr:2024-05-09T07:54:30.365+0000 7f3b9c6ee640 1 -- 172.21.15.87:0/1766819169 wait complete. 2024-05-09T07:54:30.390 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-09T07:54:30.390 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-09T07:54:30.391 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T07:54:30.391 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T07:54:30.393 INFO:tasks.ceph.mds.a:Started 2024-05-09T07:54:30.393 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T07:54:30.394 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T07:54:30.396 INFO:tasks.ceph.mds.b:Started 2024-05-09T07:54:30.397 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-09T07:54:30.397 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:30.467 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-05-09T07:54:30.480 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f0790be7640 1 Processor -- start 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f0790be7640 1 -- start start 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f0790be7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f078c0b3e30 0x7f078c141580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f0790be7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f078c141ac0 0x7f078c152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f0790be7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078c147e30 con 0x7f078c0b5e20 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f0790be7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f078c141f10 con 0x7f078c141ac0 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f0790be7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f078c0b50c0 con 0x7f078c0b3e30 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f078ad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f078c141ac0 0x7f078c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f078ad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f078c141ac0 0x7f078c152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56430/0 (socket says 172.21.15.87:56430) 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f078ad9d640 1 -- 172.21.15.87:0/2487608796 learned_addr learned my addr 172.21.15.87:0/2487608796 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:30.502 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f0781d9b640 1 --2- 172.21.15.87:0/2487608796 >> v2:172.21.15.110:3300/0 conn(0x7f078c0b3e30 0x7f078c141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f078ad9d640 1 -- 172.21.15.87:0/2487608796 >> v2:172.21.15.110:3300/0 conn(0x7f078c0b3e30 msgr2=0x7f078c141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f078ad9d640 1 --2- 172.21.15.87:0/2487608796 >> v2:172.21.15.110:3300/0 conn(0x7f078c0b3e30 0x7f078c141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f078ad9d640 1 -- 172.21.15.87:0/2487608796 >> v1:172.21.15.110:6789/0 conn(0x7f078c0b5e20 legacy=0x7f078c147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.484+0000 7f078ad9d640 1 -- 172.21.15.87:0/2487608796 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c0b5900 con 0x7f078c141ac0 2024-05-09T07:54:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f078ad9d640 1 --2- 172.21.15.87:0/2487608796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c141ac0 0x7f078c152080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f078c0b7250 tx=0x7f078402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766016bf636c5386 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f0789d9b640 1 -- 172.21.15.87:0/2487608796 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784036070 con 0x7f078c141ac0 2024-05-09T07:54:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f0789d9b640 1 -- 172.21.15.87:0/2487608796 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0784031600 con 0x7f078c141ac0 2024-05-09T07:54:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f0789d9b640 1 -- 172.21.15.87:0/2487608796 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07840319d0 con 0x7f078c141ac0 2024-05-09T07:54:30.503 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f0790be7640 1 -- 172.21.15.87:0/2487608796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c141ac0 msgr2=0x7f078c152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f0790be7640 1 --2- 172.21.15.87:0/2487608796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c141ac0 0x7f078c152080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f078c0b7250 tx=0x7f078402a730 comp rx=0 tx=0).stop 2024-05-09T07:54:30.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f0790be7640 1 -- 172.21.15.87:0/2487608796 shutdown_connections 2024-05-09T07:54:30.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f0790be7640 1 --2- 172.21.15.87:0/2487608796 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c141ac0 0x7f078c152080 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f0790be7640 1 --2- 172.21.15.87:0/2487608796 >> v2:172.21.15.110:3300/0 conn(0x7f078c0b3e30 0x7f078c141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.485+0000 7f0790be7640 1 -- 172.21.15.87:0/2487608796 >> 172.21.15.87:0/2487608796 conn(0x7f078c0676a0 msgr2=0x7f078c0bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:30.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.486+0000 7f0790be7640 1 -- 172.21.15.87:0/2487608796 shutdown_connections 2024-05-09T07:54:30.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.486+0000 7f0790be7640 1 -- 172.21.15.87:0/2487608796 wait complete. 2024-05-09T07:54:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.487+0000 7f0790be7640 1 Processor -- start 2024-05-09T07:54:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.487+0000 7f0790be7640 1 -- start start 2024-05-09T07:54:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.487+0000 7f0790be7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0b3e30 0x7f078c1dd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.487+0000 7f0790be7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c0b5e20 0x7f078c144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.487+0000 7f0790be7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c141ac0 0x7f078c143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.507 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.487+0000 7f0790be7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f078c0b6200 con 0x7f078c0b5e20 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.487+0000 7f0790be7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f078c0b4d50 con 0x7f078c141ac0 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.487+0000 7f0790be7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f078c0b5550 con 0x7f078c0b3e30 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0781d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c0b5e20 0x7f078c144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0781d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c0b5e20 0x7f078c144980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56442/0 (socket says 172.21.15.87:56442) 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0781d9b640 1 -- 172.21.15.87:0/3237420571 learned_addr learned my addr 172.21.15.87:0/3237420571 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f078ad9d640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c141ac0 0x7f078c143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f078a59c640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0b3e30 0x7f078c1dd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0781d9b640 1 -- 172.21.15.87:0/3237420571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0b3e30 msgr2=0x7f078c1dd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0781d9b640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0b3e30 0x7f078c1dd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0781d9b640 1 -- 172.21.15.87:0/3237420571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c141ac0 msgr2=0x7f078c143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0781d9b640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c141ac0 0x7f078c143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0781d9b640 1 -- 172.21.15.87:0/3237420571 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c144ec0 con 0x7f078c0b5e20 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0781d9b640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c0b5e20 0x7f078c144980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f077400d7d0 tx=0x7f077400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:30.508 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f07837fe640 1 -- 172.21.15.87:0/3237420571 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077400b6c0 con 0x7f078c0b5e20 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f07837fe640 1 -- 172.21.15.87:0/3237420571 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0774019070 con 0x7f078c0b5e20 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f07837fe640 1 -- 172.21.15.87:0/3237420571 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077400bac0 con 0x7f078c0b5e20 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078c1dcde0 con 0x7f078c0b5e20 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.488+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078c14b7b0 con 0x7f078c0b5e20 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.489+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078c0691f0 con 0x7f078c0b5e20 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.490+0000 7f07837fe640 1 -- 172.21.15.87:0/3237420571 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f077400bc60 con 0x7f078c0b5e20 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.490+0000 7f07837fe640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f076c06be30 0x7f076c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.490+0000 7f07837fe640 1 -- 172.21.15.87:0/3237420571 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f077408adf0 con 0x7f078c0b5e20 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.490+0000 7f078a59c640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f076c06be30 0x7f076c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.509 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.490+0000 7f078a59c640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f076c06be30 0x7f076c06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f077c007fd0 tx=0x7f077c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:30.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.495+0000 7f07837fe640 1 -- 172.21.15.87:0/3237420571 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f078c144ec0 con 0x7f078c0b5e20 2024-05-09T07:54:30.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.669+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f078c13f590 con 0x7f078c0b5e20 2024-05-09T07:54:30.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.669+0000 7f07837fe640 1 -- 172.21.15.87:0/3237420571 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7f0774059530 con 0x7f078c0b5e20 2024-05-09T07:54:30.685 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:30.685 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:27.058535+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f076c06be30 msgr2=0x7f076c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f076c06be30 0x7f076c06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f077c007fd0 tx=0x7f077c009040 comp rx=0 tx=0).stop 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c0b5e20 msgr2=0x7f078c144980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c0b5e20 0x7f078c144980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f077400d7d0 tx=0x7f077400dc90 comp rx=0 tx=0).stop 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 shutdown_connections 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f076c06be30 0x7f076c06e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078c141ac0 0x7f078c143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f078c0b5e20 0x7f078c144980 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 --2- 172.21.15.87:0/3237420571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f078c0b3e30 0x7f078c1dd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 >> 172.21.15.87:0/3237420571 conn(0x7f078c0676a0 msgr2=0x7f078c0bcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 shutdown_connections 2024-05-09T07:54:30.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.672+0000 7f0790be7640 1 -- 172.21.15.87:0/3237420571 wait complete. 2024-05-09T07:54:30.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T07:54:24.920922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T07:54:30.699 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T07:54:30.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.785+0000 7f31ed909640 1 Processor -- start 2024-05-09T07:54:30.801 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.785+0000 7f31ed909640 1 -- start start 2024-05-09T07:54:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31ed909640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 0x7f31e813f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31ed909640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f31e813f880 0x7f31e814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31ed909640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e80b66d0 con 0x7f31e80b6bc0 2024-05-09T07:54:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31ed909640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f31e80b6240 con 0x7f31e813f880 2024-05-09T07:54:30.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31ed909640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f31e80b08f0 con 0x7f31e80b6fa0 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31e6ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f31e80b6bc0 0x7f31e80b1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:40368/0 (socket says 172.21.15.87:40368) 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31e6ffd640 1 -- 172.21.15.87:0/1486959241 learned_addr learned my addr 172.21.15.87:0/1486959241 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105832773 0 0) 0x7f31e80b66d0 con 0x7f31e80b6bc0 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31e77fe640 1 --2- 172.21.15.87:0/1486959241 >> v2:172.21.15.110:3300/0 conn(0x7f31e813f880 0x7f31e814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.787+0000 7f31e67fc640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 0x7f31e813f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31d0003520 con 0x7f31e80b6bc0 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3351134507 0 0) 0x7f31d0003520 con 0x7f31e80b6bc0 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 msgr2=0x7f31e813f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 0x7f31e813f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 >> v2:172.21.15.110:3300/0 conn(0x7f31e813f880 msgr2=0x7f31e814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 --2- 172.21.15.87:0/1486959241 >> v2:172.21.15.110:3300/0 conn(0x7f31e813f880 0x7f31e814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e80b7400 con 0x7f31e80b6bc0 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f31d80019f0 con 0x7f31e80b6bc0 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e67fc640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 0x7f31e813f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 >> v1:172.21.15.87:6789/0 conn(0x7f31e80b6bc0 legacy=0x7f31e80b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31d00039b0 0x7f31d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0004800 0x7f31d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 0x7f31d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31e80b6240 con 0x7f31d0004800 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f31e80b08f0 con 0x7f31d00039b0 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f31d000baf0 con 0x7f31e80b6fa0 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e67fc640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0004800 0x7f31d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e77fe640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 0x7f31d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e6ffd640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31d00039b0 0x7f31d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e67fc640 1 -- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 msgr2=0x7f31d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e67fc640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 0x7f31d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e67fc640 1 -- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31d00039b0 msgr2=0x7f31d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e67fc640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31d00039b0 0x7f31d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e67fc640 1 -- 172.21.15.87:0/1486959241 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d0003520 con 0x7f31d0004800 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e77fe640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e80b6fa0 0x7f31d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e6ffd640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31d00039b0 0x7f31d0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e67fc640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0004800 0x7f31d0004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31dc006fd0 tx=0x7f31d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24320eb714008e53 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc00f040 con 0x7f31d0004800 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc02ac70 con 0x7f31d0004800 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31e5ffb640 1 -- 172.21.15.87:0/1486959241 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc004250 con 0x7f31d0004800 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31ed909640 1 -- 172.21.15.87:0/1486959241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0004800 msgr2=0x7f31d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.788+0000 7f31ed909640 1 --2- 172.21.15.87:0/1486959241 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31d0004800 0x7f31d0004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f31dc006fd0 tx=0x7f31d0005830 comp rx=0 tx=0).stop 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.789+0000 7f31e77fe640 1 -- 172.21.15.87:0/1486959241 reap_dead start 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.789+0000 7f31ed909640 1 -- 172.21.15.87:0/1486959241 shutdown_connections 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.789+0000 7f31ed909640 1 -- 172.21.15.87:0/1486959241 >> 172.21.15.87:0/1486959241 conn(0x7f31e80b7bc0 msgr2=0x7f31e80b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:30.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.789+0000 7f31ed909640 1 -- 172.21.15.87:0/1486959241 shutdown_connections 2024-05-09T07:54:30.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.789+0000 7f31ed909640 1 -- 172.21.15.87:0/1486959241 wait complete. 2024-05-09T07:54:30.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31ed909640 1 Processor -- start 2024-05-09T07:54:30.809 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31ed909640 1 -- start start 2024-05-09T07:54:30.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31ed909640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31d0004800 0x7f31e8149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31ed909640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e8145440 0x7f31e81de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31ed909640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e809bd30 0x7f31e81de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31ed909640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f31e80b5ed0 con 0x7f31e8145440 2024-05-09T07:54:30.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31ed909640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f31e80b5bf0 con 0x7f31d0004800 2024-05-09T07:54:30.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31ed909640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f31e80b2270 con 0x7f31e809bd30 2024-05-09T07:54:30.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31e67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e8145440 0x7f31e81de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31e67fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e8145440 0x7f31e81de3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56446/0 (socket says 172.21.15.87:56446) 2024-05-09T07:54:30.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.790+0000 7f31e67fc640 1 -- 172.21.15.87:0/2356755526 learned_addr learned my addr 172.21.15.87:0/2356755526 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31e67fc640 1 -- 172.21.15.87:0/2356755526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e809bd30 msgr2=0x7f31e81de8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31e67fc640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e809bd30 0x7f31e81de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31e67fc640 1 -- 172.21.15.87:0/2356755526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31d0004800 msgr2=0x7f31e8149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31e67fc640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31d0004800 0x7f31e8149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31e67fc640 1 -- 172.21.15.87:0/2356755526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e809c280 con 0x7f31e8145440 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31e67fc640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e8145440 0x7f31e81de3a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f31dc034040 tx=0x7f31dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31cffff640 1 -- 172.21.15.87:0/2356755526 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc041070 con 0x7f31e8145440 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31cffff640 1 -- 172.21.15.87:0/2356755526 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc00f000 con 0x7f31e8145440 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e8144880 con 0x7f31e8145440 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31cffff640 1 -- 172.21.15.87:0/2356755526 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc003b50 con 0x7f31e8145440 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.791+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e809adc0 con 0x7f31e8145440 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.793+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e80691f0 con 0x7f31e8145440 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.793+0000 7f31cffff640 1 -- 172.21.15.87:0/2356755526 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31dc044070 con 0x7f31e8145440 2024-05-09T07:54:30.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.794+0000 7f31cffff640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f31d406be30 0x7f31d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:30.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.794+0000 7f31cffff640 1 -- 172.21.15.87:0/2356755526 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f31dc0ab040 con 0x7f31e8145440 2024-05-09T07:54:30.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.794+0000 7f31e6ffd640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f31d406be30 0x7f31d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:30.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.794+0000 7f31e6ffd640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f31d406be30 0x7f31d406e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f31d8005db0 tx=0x7f31d80021d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:30.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.798+0000 7f31cffff640 1 -- 172.21.15.87:0/2356755526 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f31dc02ae20 con 0x7f31e8145440 2024-05-09T07:54:30.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.971+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f31e813d400 con 0x7f31e8145440 2024-05-09T07:54:30.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.972+0000 7f31cffff640 1 -- 172.21.15.87:0/2356755526 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f31dc079dd0 con 0x7f31e8145440 2024-05-09T07:54:30.986 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-09T07:54:30.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f31d406be30 msgr2=0x7f31d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f31d406be30 0x7f31d406e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f31d8005db0 tx=0x7f31d80021d0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e8145440 msgr2=0x7f31e81de3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:30.988 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e8145440 0x7f31e81de3a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f31dc034040 tx=0x7f31dc004730 comp rx=0 tx=0).stop 2024-05-09T07:54:30.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 shutdown_connections 2024-05-09T07:54:30.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f31d406be30 0x7f31d406e2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31e809bd30 0x7f31e81de8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f31e8145440 0x7f31e81de3a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 --2- 172.21.15.87:0/2356755526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31d0004800 0x7f31e8149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:30.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.973+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 >> 172.21.15.87:0/2356755526 conn(0x7f31e80b7bc0 msgr2=0x7f31e8071770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:30.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.974+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 shutdown_connections 2024-05-09T07:54:30.989 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:30.974+0000 7f31ed909640 1 -- 172.21.15.87:0/2356755526 wait complete. 2024-05-09T07:54:30.999 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T07:54:31.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.086+0000 7fbb380ba640 1 Processor -- start 2024-05-09T07:54:31.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.086+0000 7fbb380ba640 1 -- start start 2024-05-09T07:54:31.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb380ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbb300b5e60 0x7fbb300b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb380ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5330 0x7fbb300b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb380ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb300b6240 con 0x7fbb300b2770 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb380ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fbb300b0470 con 0x7fbb300b5e60 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb380ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbb300b2c00 con 0x7fbb300b5330 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb35e56640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbb300b5e60 0x7fbb300b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb36657640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbb300b2770 0x7fbb30146bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:51606/0 (socket says 172.21.15.87:51606) 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb36657640 1 -- 172.21.15.87:0/1954320135 learned_addr learned my addr 172.21.15.87:0/1954320135 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb35e56640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbb300b5e60 0x7fbb300b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:54524/0 (socket says 172.21.15.87:54524) 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.087+0000 7fbb35655640 1 --2- 172.21.15.87:0/1954320135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5330 0x7fbb300b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.088+0000 7fbb35e56640 1 -- 172.21.15.87:0/1954320135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5330 msgr2=0x7fbb300b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.088+0000 7fbb35e56640 1 --2- 172.21.15.87:0/1954320135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5330 0x7fbb300b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.088+0000 7fbb35e56640 1 -- 172.21.15.87:0/1954320135 >> v1:172.21.15.110:6789/0 conn(0x7fbb300b2770 legacy=0x7fbb30146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.088+0000 7fbb35e56640 1 -- 172.21.15.87:0/1954320135 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb300b1860 con 0x7fbb300b5e60 2024-05-09T07:54:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.088+0000 7fbb34e54640 1 -- 172.21.15.87:0/1954320135 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917459701 0 0) 0x7fbb300b6240 con 0x7fbb300b2770 2024-05-09T07:54:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.088+0000 7fbb35655640 1 --2- 172.21.15.87:0/1954320135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5330 0x7fbb300b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.088+0000 7fbb35e56640 1 --2- 172.21.15.87:0/1954320135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb300b5e60 0x7fbb300b1cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009d90 tx=0x7fbb2c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b615b3eb3d5a4c8a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb34e54640 1 -- 172.21.15.87:0/1954320135 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c031600 con 0x7fbb300b5e60 2024-05-09T07:54:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb34e54640 1 -- 172.21.15.87:0/1954320135 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2c0317a0 con 0x7fbb300b5e60 2024-05-09T07:54:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb34e54640 1 -- 172.21.15.87:0/1954320135 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c031b70 con 0x7fbb300b5e60 2024-05-09T07:54:31.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb380ba640 1 -- 172.21.15.87:0/1954320135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb300b5e60 msgr2=0x7fbb300b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb380ba640 1 --2- 172.21.15.87:0/1954320135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb300b5e60 0x7fbb300b1cf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009d90 tx=0x7fbb2c02a5d0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb380ba640 1 -- 172.21.15.87:0/1954320135 shutdown_connections 2024-05-09T07:54:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb380ba640 1 --2- 172.21.15.87:0/1954320135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5330 0x7fbb300b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb380ba640 1 --2- 172.21.15.87:0/1954320135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb300b5e60 0x7fbb300b1cf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb380ba640 1 -- 172.21.15.87:0/1954320135 >> 172.21.15.87:0/1954320135 conn(0x7fbb3006c6a0 msgr2=0x7fbb3006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb380ba640 1 -- 172.21.15.87:0/1954320135 shutdown_connections 2024-05-09T07:54:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.089+0000 7fbb380ba640 1 -- 172.21.15.87:0/1954320135 wait complete. 2024-05-09T07:54:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.090+0000 7fbb380ba640 1 Processor -- start 2024-05-09T07:54:31.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.090+0000 7fbb380ba640 1 -- start start 2024-05-09T07:54:31.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb380ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb300b2770 0x7fbb300b9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb380ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5330 0x7fbb30140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb380ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5e60 0x7fbb3009dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb380ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300af960 con 0x7fbb300b5330 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb380ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300b1580 con 0x7fbb300b2770 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb380ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbb300afae0 con 0x7fbb300b5e60 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35655640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5330 0x7fbb30140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35655640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5330 0x7fbb30140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56456/0 (socket says 172.21.15.87:56456) 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35655640 1 -- 172.21.15.87:0/1600484989 learned_addr learned my addr 172.21.15.87:0/1600484989 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35e56640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb300b2770 0x7fbb300b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb36657640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5e60 0x7fbb3009dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35655640 1 -- 172.21.15.87:0/1600484989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5e60 msgr2=0x7fbb3009dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35655640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5e60 0x7fbb3009dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35655640 1 -- 172.21.15.87:0/1600484989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb300b2770 msgr2=0x7fbb300b9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:31.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35655640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb300b2770 0x7fbb300b9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35655640 1 -- 172.21.15.87:0/1600484989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3009c370 con 0x7fbb300b5330 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb35655640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5330 0x7fbb30140930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000ec10 tx=0x7fbb2000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb267fc640 1 -- 172.21.15.87:0/1600484989 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20017070 con 0x7fbb300b5330 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb267fc640 1 -- 172.21.15.87:0/1600484989 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2000cc30 con 0x7fbb300b5330 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb300b8b60 con 0x7fbb300b5330 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.091+0000 7fbb267fc640 1 -- 172.21.15.87:0/1600484989 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20013470 con 0x7fbb300b5330 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.092+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb300b7e00 con 0x7fbb300b5330 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.092+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb300691f0 con 0x7fbb300b5330 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.093+0000 7fbb267fc640 1 -- 172.21.15.87:0/1600484989 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb2001a070 con 0x7fbb300b5330 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.093+0000 7fbb267fc640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbb1406be60 0x7fbb1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.093+0000 7fbb267fc640 1 -- 172.21.15.87:0/1600484989 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fbb2008aca0 con 0x7fbb300b5330 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.093+0000 7fbb35e56640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbb1406be60 0x7fbb1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:31.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.094+0000 7fbb35e56640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbb1406be60 0x7fbb1406e320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c034000 tx=0x7fbb2c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:31.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.098+0000 7fbb267fc640 1 -- 172.21.15.87:0/1600484989 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbb200593e0 con 0x7fbb300b5330 2024-05-09T07:54:31.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.311+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb300b5060 con 0x7fbb300b5330 2024-05-09T07:54:31.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.312+0000 7fbb267fc640 1 -- 172.21.15.87:0/1600484989 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fbb2005d6e0 con 0x7fbb300b5330 2024-05-09T07:54:31.326 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:31.327 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2148825985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2148825985},{"type":"v1","addr":"172.21.15.87:6835","nonce":2148825985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T07:54:31.327 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 2 2024-05-09T07:54:31.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.313+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbb1406be60 msgr2=0x7fbb1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:31.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.313+0000 7fbb380ba640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbb1406be60 0x7fbb1406e320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c034000 tx=0x7fbb2c02f000 comp rx=0 tx=0).stop 2024-05-09T07:54:31.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.313+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5330 msgr2=0x7fbb30140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:31.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.313+0000 7fbb380ba640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5330 0x7fbb30140930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000ec10 tx=0x7fbb2000c520 comp rx=0 tx=0).stop 2024-05-09T07:54:31.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.313+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 shutdown_connections 2024-05-09T07:54:31.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.314+0000 7fbb380ba640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbb1406be60 0x7fbb1406e320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.314+0000 7fbb380ba640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb300b5e60 0x7fbb3009dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.314+0000 7fbb380ba640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbb300b5330 0x7fbb30140930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.314+0000 7fbb380ba640 1 --2- 172.21.15.87:0/1600484989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb300b2770 0x7fbb300b9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:31.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.314+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 >> 172.21.15.87:0/1600484989 conn(0x7fbb3006c6a0 msgr2=0x7fbb3013dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:31.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.314+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 shutdown_connections 2024-05-09T07:54:31.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:31.314+0000 7fbb380ba640 1 -- 172.21.15.87:0/1600484989 wait complete. 2024-05-09T07:54:33.340 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T07:54:33.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.437+0000 7f2de04ca640 1 Processor -- start 2024-05-09T07:54:33.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.437+0000 7f2de04ca640 1 -- start start 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.437+0000 7f2de04ca640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b5330 0x7f2dd80b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.437+0000 7f2de04ca640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd80b6240 con 0x7f2dd80b2940 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.437+0000 7f2de04ca640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd80b1860 con 0x7f2dd80b5e60 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.437+0000 7f2de04ca640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd80b0470 con 0x7f2dd80b5330 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddea67640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2dd80b2940 0x7f2dd8147bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38960/0 (socket says 172.21.15.87:38960) 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddea67640 1 -- 172.21.15.87:0/3649426362 learned_addr learned my addr 172.21.15.87:0/3649426362 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddda65640 1 --2- 172.21.15.87:0/3649426362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b5330 0x7f2dd80b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddd264640 1 -- 172.21.15.87:0/3649426362 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296554357 0 0) 0x7f2dd80b6240 con 0x7f2dd80b2940 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddd264640 1 -- 172.21.15.87:0/3649426362 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc4003520 con 0x7f2dd80b2940 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddd264640 1 -- 172.21.15.87:0/3649426362 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 818717542 0 0) 0x7f2dd80b1860 con 0x7f2dd80b5e60 2024-05-09T07:54:33.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddd264640 1 -- 172.21.15.87:0/3649426362 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dd80b6240 con 0x7f2dd80b5e60 2024-05-09T07:54:33.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddda65640 1 -- 172.21.15.87:0/3649426362 >> v1:172.21.15.110:6789/0 conn(0x7f2dd80b5e60 legacy=0x7f2dd80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddda65640 1 -- 172.21.15.87:0/3649426362 >> v1:172.21.15.87:6789/0 conn(0x7f2dd80b2940 legacy=0x7f2dd8147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.454 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.438+0000 7f2ddda65640 1 -- 172.21.15.87:0/3649426362 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd80afd40 con 0x7f2dd80b5330 2024-05-09T07:54:33.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.439+0000 7f2ddda65640 1 --2- 172.21.15.87:0/3649426362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b5330 0x7f2dd80b2400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009dc0 tx=0x7f2dd402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79e0bd8d3c1ef34 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:33.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.439+0000 7f2ddd264640 1 -- 172.21.15.87:0/3649426362 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd402ae60 con 0x7f2dd80b5330 2024-05-09T07:54:33.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.439+0000 7f2ddd264640 1 -- 172.21.15.87:0/3649426362 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd4007740 con 0x7f2dd80b5330 2024-05-09T07:54:33.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.439+0000 7f2ddd264640 1 -- 172.21.15.87:0/3649426362 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4007b10 con 0x7f2dd80b5330 2024-05-09T07:54:33.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.440+0000 7f2de04ca640 1 -- 172.21.15.87:0/3649426362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b5330 msgr2=0x7f2dd80b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.440+0000 7f2de04ca640 1 --2- 172.21.15.87:0/3649426362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b5330 0x7f2dd80b2400 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4009dc0 tx=0x7f2dd402a640 comp rx=0 tx=0).stop 2024-05-09T07:54:33.455 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.440+0000 7f2de04ca640 1 -- 172.21.15.87:0/3649426362 shutdown_connections 2024-05-09T07:54:33.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.440+0000 7f2de04ca640 1 --2- 172.21.15.87:0/3649426362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b5330 0x7f2dd80b2400 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.440+0000 7f2de04ca640 1 -- 172.21.15.87:0/3649426362 >> 172.21.15.87:0/3649426362 conn(0x7f2dd806c6a0 msgr2=0x7f2dd806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:33.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.440+0000 7f2de04ca640 1 -- 172.21.15.87:0/3649426362 shutdown_connections 2024-05-09T07:54:33.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.440+0000 7f2de04ca640 1 -- 172.21.15.87:0/3649426362 wait complete. 2024-05-09T07:54:33.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.441+0000 7f2de04ca640 1 Processor -- start 2024-05-09T07:54:33.456 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.441+0000 7f2de04ca640 1 -- start start 2024-05-09T07:54:33.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.441+0000 7f2de04ca640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b2940 0x7f2dd80b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.441+0000 7f2de04ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dd80b5330 0x7f2dd8143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.441+0000 7f2de04ca640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd80b5e60 0x7f2dd81cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.441+0000 7f2de04ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd81482e0 con 0x7f2dd80b5330 2024-05-09T07:54:33.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.441+0000 7f2de04ca640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd80b1580 con 0x7f2dd80b5e60 2024-05-09T07:54:33.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.441+0000 7f2de04ca640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd8148460 con 0x7f2dd80b2940 2024-05-09T07:54:33.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddda65640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dd80b5330 0x7f2dd8143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.458 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddda65640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dd80b5330 0x7f2dd8143890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47174/0 (socket says 172.21.15.87:47174) 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddda65640 1 -- 172.21.15.87:0/2235993031 learned_addr learned my addr 172.21.15.87:0/2235993031 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddea67640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd80b5e60 0x7f2dd81cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2dde266640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b2940 0x7f2dd80b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddda65640 1 -- 172.21.15.87:0/2235993031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b2940 msgr2=0x7f2dd80b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddda65640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b2940 0x7f2dd80b8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddda65640 1 -- 172.21.15.87:0/2235993031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd80b5e60 msgr2=0x7f2dd81cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddda65640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd80b5e60 0x7f2dd81cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddda65640 1 -- 172.21.15.87:0/2235993031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd8142cb0 con 0x7f2dd80b5330 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2ddda65640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dd80b5330 0x7f2dd8143890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4000f80 tx=0x7f2dd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2dceffd640 1 -- 172.21.15.87:0/2235993031 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4040070 con 0x7f2dd80b5330 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2dceffd640 1 -- 172.21.15.87:0/2235993031 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dd402ae60 con 0x7f2dd80b5330 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd8142f90 con 0x7f2dd80b5330 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2dceffd640 1 -- 172.21.15.87:0/2235993031 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4031c60 con 0x7f2dd80b5330 2024-05-09T07:54:33.459 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.442+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd8141c80 con 0x7f2dd80b5330 2024-05-09T07:54:33.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.443+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd80691f0 con 0x7f2dd80b5330 2024-05-09T07:54:33.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.444+0000 7f2dceffd640 1 -- 172.21.15.87:0/2235993031 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2dd4039040 con 0x7f2dd80b5330 2024-05-09T07:54:33.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.444+0000 7f2dceffd640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2dbc06be30 0x7f2dbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.444+0000 7f2dceffd640 1 -- 172.21.15.87:0/2235993031 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2dd40abf40 con 0x7f2dd80b5330 2024-05-09T07:54:33.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.444+0000 7f2dde266640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2dbc06be30 0x7f2dbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.460 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.445+0000 7f2dde266640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2dbc06be30 0x7f2dbc06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8007fd0 tx=0x7f2dc8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:33.463 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.449+0000 7f2dceffd640 1 -- 172.21.15.87:0/2235993031 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2dd407a680 con 0x7f2dd80b5330 2024-05-09T07:54:33.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.657+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dd8072250 con 0x7f2dd80b5330 2024-05-09T07:54:33.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.658+0000 7f2dceffd640 1 -- 172.21.15.87:0/2235993031 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2216 (secure 0 0 0) 0x7f2dd407e980 con 0x7f2dd80b5330 2024-05-09T07:54:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:33.673 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/138437726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":138437726},{"type":"v1","addr":"172.21.15.110:6833","nonce":138437726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6835/2148825985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2148825985},{"type":"v1","addr":"172.21.15.87:6835","nonce":2148825985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T07:54:33.673 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 3 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2dbc06be30 msgr2=0x7f2dbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2dbc06be30 0x7f2dbc06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8007fd0 tx=0x7f2dc8009040 comp rx=0 tx=0).stop 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dd80b5330 msgr2=0x7f2dd8143890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dd80b5330 0x7f2dd8143890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4000f80 tx=0x7f2dd4004a40 comp rx=0 tx=0).stop 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 shutdown_connections 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2dbc06be30 0x7f2dbc06e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dd80b5e60 0x7f2dd81cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2dd80b5330 0x7f2dd8143890 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 --2- 172.21.15.87:0/2235993031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dd80b2940 0x7f2dd80b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 >> 172.21.15.87:0/2235993031 conn(0x7f2dd806c6a0 msgr2=0x7f2dd80b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:33.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 shutdown_connections 2024-05-09T07:54:33.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.660+0000 7f2de04ca640 1 -- 172.21.15.87:0/2235993031 wait complete. 2024-05-09T07:54:33.686 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:33.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.771+0000 7feffa2da640 1 Processor -- start 2024-05-09T07:54:33.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.771+0000 7feffa2da640 1 -- start start 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.771+0000 7feffa2da640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5e60 0x7feff40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.771+0000 7feffa2da640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feff40b2940 0x7feff4147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.771+0000 7feffa2da640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff40b6240 con 0x7feff40b5330 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.771+0000 7feffa2da640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7feff40b0470 con 0x7feff40b2940 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.771+0000 7feffa2da640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7feff40b1580 con 0x7feff40b5e60 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.772+0000 7feff8877640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feff40b2940 0x7feff4147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.772+0000 7feff8877640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7feff40b2940 0x7feff4147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47184/0 (socket says 172.21.15.87:47184) 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.772+0000 7feff8877640 1 -- 172.21.15.87:0/828931791 learned_addr learned my addr 172.21.15.87:0/828931791 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.772+0000 7feff3fff640 1 --2- 172.21.15.87:0/828931791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5e60 0x7feff40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.772+0000 7feff8877640 1 -- 172.21.15.87:0/828931791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5e60 msgr2=0x7feff40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.772+0000 7feff8877640 1 --2- 172.21.15.87:0/828931791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5e60 0x7feff40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.772+0000 7feff8877640 1 -- 172.21.15.87:0/828931791 >> v1:172.21.15.110:6789/0 conn(0x7feff40b5330 legacy=0x7feff40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.772+0000 7feff8877640 1 -- 172.21.15.87:0/828931791 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff40b1860 con 0x7feff40b2940 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.772+0000 7feff3fff640 1 --2- 172.21.15.87:0/828931791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5e60 0x7feff40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feff8877640 1 --2- 172.21.15.87:0/828931791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b2940 0x7feff4147bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fefec009e80 tx=0x7fefec02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799df6be7cee938f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feff2ffd640 1 -- 172.21.15.87:0/828931791 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec036070 con 0x7feff40b2940 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feff2ffd640 1 -- 172.21.15.87:0/828931791 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefec031600 con 0x7feff40b2940 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feff2ffd640 1 -- 172.21.15.87:0/828931791 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec0319d0 con 0x7feff40b2940 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feffa2da640 1 -- 172.21.15.87:0/828931791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b2940 msgr2=0x7feff4147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.789 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feffa2da640 1 --2- 172.21.15.87:0/828931791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b2940 0x7feff4147bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fefec009e80 tx=0x7fefec02a6c0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feffa2da640 1 -- 172.21.15.87:0/828931791 shutdown_connections 2024-05-09T07:54:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feffa2da640 1 --2- 172.21.15.87:0/828931791 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b2940 0x7feff4147bd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feffa2da640 1 --2- 172.21.15.87:0/828931791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5e60 0x7feff40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feffa2da640 1 -- 172.21.15.87:0/828931791 >> 172.21.15.87:0/828931791 conn(0x7feff406c6a0 msgr2=0x7feff406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feffa2da640 1 -- 172.21.15.87:0/828931791 shutdown_connections 2024-05-09T07:54:33.790 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.773+0000 7feffa2da640 1 -- 172.21.15.87:0/828931791 wait complete. 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.774+0000 7feffa2da640 1 Processor -- start 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.774+0000 7feffa2da640 1 -- start start 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feffa2da640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feff40b2940 0x7feff413daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feffa2da640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5330 0x7feff41ddb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feffa2da640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b5e60 0x7feff41d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feffa2da640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7feff40afae0 con 0x7feff40b5e60 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feffa2da640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7feff40af960 con 0x7feff40b2940 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feffa2da640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7feff4148110 con 0x7feff40b5330 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff8877640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b5e60 0x7feff41d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff8877640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b5e60 0x7feff41d06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47186/0 (socket says 172.21.15.87:47186) 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff8877640 1 -- 172.21.15.87:0/3087622870 learned_addr learned my addr 172.21.15.87:0/3087622870 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff3fff640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feff40b2940 0x7feff413daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff37fe640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5330 0x7feff41ddb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.793 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff8877640 1 -- 172.21.15.87:0/3087622870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5330 msgr2=0x7feff41ddb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff8877640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5330 0x7feff41ddb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff8877640 1 -- 172.21.15.87:0/3087622870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feff40b2940 msgr2=0x7feff413daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff8877640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feff40b2940 0x7feff413daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff8877640 1 -- 172.21.15.87:0/3087622870 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff413dfe0 con 0x7feff40b5e60 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff3fff640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feff40b2940 0x7feff413daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.775+0000 7feff8877640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b5e60 0x7feff41d06d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fefec034040 tx=0x7fefec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.776+0000 7feff0ff9640 1 -- 172.21.15.87:0/3087622870 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec009510 con 0x7feff40b5e60 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.776+0000 7feff0ff9640 1 -- 172.21.15.87:0/3087622870 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefec007990 con 0x7feff40b5e60 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.776+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff41cf520 con 0x7feff40b5e60 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.776+0000 7feff0ff9640 1 -- 172.21.15.87:0/3087622870 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec007d80 con 0x7feff40b5e60 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.776+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff41d9eb0 con 0x7feff40b5e60 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.777+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff40691f0 con 0x7feff40b5e60 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.777+0000 7feff0ff9640 1 -- 172.21.15.87:0/3087622870 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fefec039400 con 0x7feff40b5e60 2024-05-09T07:54:33.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.778+0000 7feff0ff9640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fefe006be30 0x7fefe006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:33.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.778+0000 7feff3fff640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fefe006be30 0x7fefe006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:33.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.778+0000 7feff0ff9640 1 -- 172.21.15.87:0/3087622870 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fefec0ad8c0 con 0x7feff40b5e60 2024-05-09T07:54:33.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.778+0000 7feff3fff640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fefe006be30 0x7fefe006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fefe4006fd0 tx=0x7fefe4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:33.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.782+0000 7feff0ff9640 1 -- 172.21.15.87:0/3087622870 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fefec07c000 con 0x7feff40b5e60 2024-05-09T07:54:33.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.957+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feff40720f0 con 0x7feff40b5e60 2024-05-09T07:54:33.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.958+0000 7feff0ff9640 1 -- 172.21.15.87:0/3087622870 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7fefec080300 con 0x7feff40b5e60 2024-05-09T07:54:33.972 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:33.973 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":17,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:27.058535+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fefe006be30 msgr2=0x7fefe006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fefe006be30 0x7fefe006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fefe4006fd0 tx=0x7fefe4008040 comp rx=0 tx=0).stop 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b5e60 msgr2=0x7feff41d06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b5e60 0x7feff41d06d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fefec034040 tx=0x7fefec004a40 comp rx=0 tx=0).stop 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 shutdown_connections 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fefe006be30 0x7fefe006e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feff40b5330 0x7feff41ddb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7feff40b5e60 0x7feff41d06d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 --2- 172.21.15.87:0/3087622870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feff40b2940 0x7feff413daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 >> 172.21.15.87:0/3087622870 conn(0x7feff406c6a0 msgr2=0x7feff40706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 shutdown_connections 2024-05-09T07:54:33.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:33.960+0000 7feffa2da640 1 -- 172.21.15.87:0/3087622870 wait complete. 2024-05-09T07:54:33.985 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T07:54:24.920922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T07:54:33.986 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T07:54:34.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.073+0000 7f4cf693b640 1 Processor -- start 2024-05-09T07:54:34.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cf693b640 1 -- start start 2024-05-09T07:54:34.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cf693b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4cf00af520 0x7f4cf00729b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cf693b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4cf01444a0 0x7f4cf0072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cf693b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf00b5d80 0x7f4cf0145910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cf693b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf00b08c0 con 0x7f4cf01444a0 2024-05-09T07:54:34.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cf693b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf00af900 con 0x7f4cf00af520 2024-05-09T07:54:34.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cf693b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf0144a30 con 0x7f4cf00b5d80 2024-05-09T07:54:34.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cef7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4cf01444a0 0x7f4cf0072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cef7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4cf01444a0 0x7f4cf0072ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47188/0 (socket says 172.21.15.87:47188) 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cef7fe640 1 -- 172.21.15.87:0/3540350699 learned_addr learned my addr 172.21.15.87:0/3540350699 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4ceffff640 1 --2- 172.21.15.87:0/3540350699 >> v2:172.21.15.110:3300/0 conn(0x7f4cf00af520 0x7f4cf00729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.074+0000 7f4cf4ed8640 1 --2- 172.21.15.87:0/3540350699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf00b5d80 0x7f4cf0145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4cef7fe640 1 -- 172.21.15.87:0/3540350699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf00b5d80 msgr2=0x7f4cf0145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4cef7fe640 1 --2- 172.21.15.87:0/3540350699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf00b5d80 0x7f4cf0145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4cef7fe640 1 -- 172.21.15.87:0/3540350699 >> v2:172.21.15.110:3300/0 conn(0x7f4cf00af520 msgr2=0x7f4cf00729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4cef7fe640 1 --2- 172.21.15.87:0/3540350699 >> v2:172.21.15.110:3300/0 conn(0x7f4cf00af520 0x7f4cf00729b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4cef7fe640 1 -- 172.21.15.87:0/3540350699 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf0144d10 con 0x7f4cf01444a0 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4ceffff640 1 --2- 172.21.15.87:0/3540350699 >> v2:172.21.15.110:3300/0 conn(0x7f4cf00af520 0x7f4cf00729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4cef7fe640 1 --2- 172.21.15.87:0/3540350699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf01444a0 0x7f4cf0072ef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4cf006c540 tx=0x7f4ce402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf750440391542d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4ceeffd640 1 -- 172.21.15.87:0/3540350699 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4037070 con 0x7f4cf01444a0 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4ceeffd640 1 -- 172.21.15.87:0/3540350699 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce4032440 con 0x7f4cf01444a0 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.075+0000 7f4ceeffd640 1 -- 172.21.15.87:0/3540350699 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4032810 con 0x7f4cf01444a0 2024-05-09T07:54:34.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.076+0000 7f4cf693b640 1 -- 172.21.15.87:0/3540350699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf01444a0 msgr2=0x7f4cf0072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.076+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3540350699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf01444a0 0x7f4cf0072ef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4cf006c540 tx=0x7f4ce402a140 comp rx=0 tx=0).stop 2024-05-09T07:54:34.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.076+0000 7f4cf693b640 1 -- 172.21.15.87:0/3540350699 shutdown_connections 2024-05-09T07:54:34.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.076+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3540350699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf00b5d80 0x7f4cf0145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.076+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3540350699 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf01444a0 0x7f4cf0072ef0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.076+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3540350699 >> v2:172.21.15.110:3300/0 conn(0x7f4cf00af520 0x7f4cf00729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.076+0000 7f4cf693b640 1 -- 172.21.15.87:0/3540350699 >> 172.21.15.87:0/3540350699 conn(0x7f4cf00b69c0 msgr2=0x7f4cf00b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:34.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.076+0000 7f4cf693b640 1 -- 172.21.15.87:0/3540350699 shutdown_connections 2024-05-09T07:54:34.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.076+0000 7f4cf693b640 1 -- 172.21.15.87:0/3540350699 wait complete. 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.077+0000 7f4cf693b640 1 Processor -- start 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.077+0000 7f4cf693b640 1 -- start start 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4cf693b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf00af520 0x7f4cf01de680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4cf693b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf00b5d80 0x7f4cf01debc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4cf693b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf01444a0 0x7f4cf013cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4cf693b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0145fd0 con 0x7f4cf00af520 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4cf693b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0145e50 con 0x7f4cf00b5d80 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4cf693b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf0146150 con 0x7f4cf01444a0 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4ceffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf00af520 0x7f4cf01de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4ceffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf00af520 0x7f4cf01de680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47200/0 (socket says 172.21.15.87:47200) 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4ceffff640 1 -- 172.21.15.87:0/3342479977 learned_addr learned my addr 172.21.15.87:0/3342479977 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4cf4ed8640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf01444a0 0x7f4cf013cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4cef7fe640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf00b5d80 0x7f4cf01debc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4ceffff640 1 -- 172.21.15.87:0/3342479977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf01444a0 msgr2=0x7f4cf013cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4ceffff640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf01444a0 0x7f4cf013cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4ceffff640 1 -- 172.21.15.87:0/3342479977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf00b5d80 msgr2=0x7f4cf01debc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4ceffff640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf00b5d80 0x7f4cf01debc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4ceffff640 1 -- 172.21.15.87:0/3342479977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf006e550 con 0x7f4cf00af520 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4cef7fe640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf00b5d80 0x7f4cf01debc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.078+0000 7f4ceffff640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf00af520 0x7f4cf01de680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000d7d0 tx=0x7f4ce000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.079+0000 7f4cecff9640 1 -- 172.21.15.87:0/3342479977 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0004030 con 0x7f4cf00af520 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.079+0000 7f4cecff9640 1 -- 172.21.15.87:0/3342479977 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce00041d0 con 0x7f4cf00af520 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.079+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf006e830 con 0x7f4cf00af520 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.079+0000 7f4cecff9640 1 -- 172.21.15.87:0/3342479977 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000b6c0 con 0x7f4cf00af520 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.079+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf013e140 con 0x7f4cf00af520 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.080+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf00691f0 con 0x7f4cf00af520 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.080+0000 7f4cecff9640 1 -- 172.21.15.87:0/3342479977 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ce000b860 con 0x7f4cf00af520 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.080+0000 7f4cecff9640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.080+0000 7f4cecff9640 1 -- 172.21.15.87:0/3342479977 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4ce008acf0 con 0x7f4cf00af520 2024-05-09T07:54:34.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.080+0000 7f4cef7fe640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.081+0000 7f4cef7fe640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4034000 tx=0x7f4ce402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:34.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.085+0000 7f4cecff9640 1 -- 172.21.15.87:0/3342479977 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4ce008f070 con 0x7f4cf00af520 2024-05-09T07:54:34.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.260+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cf0071390 con 0x7f4cf00af520 2024-05-09T07:54:34.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.260+0000 7f4cecff9640 1 -- 172.21.15.87:0/3342479977 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f4ce0059a80 con 0x7f4cf00af520 2024-05-09T07:54:34.275 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-09T07:54:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f4cdc06be30 msgr2=0x7f4cdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4034000 tx=0x7f4ce402e000 comp rx=0 tx=0).stop 2024-05-09T07:54:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf00af520 msgr2=0x7f4cf01de680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf00af520 0x7f4cf01de680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000d7d0 tx=0x7f4ce000dc90 comp rx=0 tx=0).stop 2024-05-09T07:54:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 shutdown_connections 2024-05-09T07:54:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f4cdc06be30 0x7f4cdc06e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf01444a0 0x7f4cf013cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.277 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf00b5d80 0x7f4cf01debc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 --2- 172.21.15.87:0/3342479977 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4cf00af520 0x7f4cf01de680 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 >> 172.21.15.87:0/3342479977 conn(0x7f4cf00b69c0 msgr2=0x7f4cf00b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 shutdown_connections 2024-05-09T07:54:34.278 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.262+0000 7f4cf693b640 1 -- 172.21.15.87:0/3342479977 wait complete. 2024-05-09T07:54:34.288 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T07:54:34.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.372+0000 7f9a2c51d640 1 Processor -- start 2024-05-09T07:54:34.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.372+0000 7f9a2c51d640 1 -- start start 2024-05-09T07:54:34.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2c51d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9a240b5e60 0x7f9a24072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2c51d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a2413fb60 0x7f9a241496e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2c51d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a240b6240 con 0x7f9a24149280 2024-05-09T07:54:34.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2c51d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9a240b2cb0 con 0x7f9a2413fb60 2024-05-09T07:54:34.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2c51d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f9a240b31c0 con 0x7f9a240b5e60 2024-05-09T07:54:34.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2aaba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9a2413fb60 0x7f9a241496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a29ab8640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9a24149280 0x7f9a2413f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38968/0 (socket says 172.21.15.87:38968) 2024-05-09T07:54:34.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a29ab8640 1 -- 172.21.15.87:0/287053854 learned_addr learned my addr 172.21.15.87:0/287053854 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:34.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2a2b9640 1 --2- 172.21.15.87:0/287053854 >> v2:172.21.15.110:3300/0 conn(0x7f9a240b5e60 0x7f9a24072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2aaba640 1 -- 172.21.15.87:0/287053854 >> v2:172.21.15.110:3300/0 conn(0x7f9a240b5e60 msgr2=0x7f9a24072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:34.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2aaba640 1 --2- 172.21.15.87:0/287053854 >> v2:172.21.15.110:3300/0 conn(0x7f9a240b5e60 0x7f9a24072cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2aaba640 1 -- 172.21.15.87:0/287053854 >> v1:172.21.15.87:6789/0 conn(0x7f9a24149280 legacy=0x7f9a2413f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a2aaba640 1 -- 172.21.15.87:0/287053854 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a240b5570 con 0x7f9a2413fb60 2024-05-09T07:54:34.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.373+0000 7f9a292b7640 1 -- 172.21.15.87:0/287053854 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152931522 0 0) 0x7f9a240b6240 con 0x7f9a24149280 2024-05-09T07:54:34.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.374+0000 7f9a2aaba640 1 --2- 172.21.15.87:0/287053854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 0x7f9a241496e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a240b0020 tx=0x7f9a1c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700477f92ab0d41f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:34.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.374+0000 7f9a292b7640 1 -- 172.21.15.87:0/287053854 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c007740 con 0x7f9a2413fb60 2024-05-09T07:54:34.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.374+0000 7f9a292b7640 1 -- 172.21.15.87:0/287053854 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1c0078e0 con 0x7f9a2413fb60 2024-05-09T07:54:34.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.374+0000 7f9a292b7640 1 -- 172.21.15.87:0/287053854 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c007cb0 con 0x7f9a2413fb60 2024-05-09T07:54:34.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.375+0000 7f9a2c51d640 1 -- 172.21.15.87:0/287053854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 msgr2=0x7f9a241496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.375+0000 7f9a2c51d640 1 --2- 172.21.15.87:0/287053854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 0x7f9a241496e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a240b0020 tx=0x7f9a1c02a5f0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.375+0000 7f9a2c51d640 1 -- 172.21.15.87:0/287053854 shutdown_connections 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.375+0000 7f9a2c51d640 1 --2- 172.21.15.87:0/287053854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 0x7f9a241496e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.375+0000 7f9a2c51d640 1 --2- 172.21.15.87:0/287053854 >> v2:172.21.15.110:3300/0 conn(0x7f9a240b5e60 0x7f9a24072cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.375+0000 7f9a2c51d640 1 -- 172.21.15.87:0/287053854 >> 172.21.15.87:0/287053854 conn(0x7f9a2406c6a0 msgr2=0x7f9a2406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.375+0000 7f9a2c51d640 1 -- 172.21.15.87:0/287053854 shutdown_connections 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.375+0000 7f9a2c51d640 1 -- 172.21.15.87:0/287053854 wait complete. 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.376+0000 7f9a2c51d640 1 Processor -- start 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.376+0000 7f9a2c51d640 1 -- start start 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a2c51d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a240b5e60 0x7f9a241de650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a2c51d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 0x7f9a2413e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a2c51d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a24149280 0x7f9a24135e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a2c51d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2409ee00 con 0x7f9a2413fb60 2024-05-09T07:54:34.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a2c51d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9a24148df0 con 0x7f9a240b5e60 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a2c51d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9a2409ef80 con 0x7f9a24149280 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a29ab8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 0x7f9a2413e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a29ab8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 0x7f9a2413e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47206/0 (socket says 172.21.15.87:47206) 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a29ab8640 1 -- 172.21.15.87:0/2851397411 learned_addr learned my addr 172.21.15.87:0/2851397411 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a29ab8640 1 -- 172.21.15.87:0/2851397411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a24149280 msgr2=0x7f9a24135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a29ab8640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a24149280 0x7f9a24135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a29ab8640 1 -- 172.21.15.87:0/2851397411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a240b5e60 msgr2=0x7f9a241de650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a29ab8640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a240b5e60 0x7f9a241de650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a29ab8640 1 -- 172.21.15.87:0/2851397411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a24147420 con 0x7f9a2413fb60 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a29ab8640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 0x7f9a2413e740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c460 tx=0x7f9a1400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a1affd640 1 -- 172.21.15.87:0/2851397411 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14018070 con 0x7f9a2413fb60 2024-05-09T07:54:34.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a1affd640 1 -- 172.21.15.87:0/2851397411 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a14007500 con 0x7f9a2413fb60 2024-05-09T07:54:34.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a241deb90 con 0x7f9a2413fb60 2024-05-09T07:54:34.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a1affd640 1 -- 172.21.15.87:0/2851397411 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14004a20 con 0x7f9a2413fb60 2024-05-09T07:54:34.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.377+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a2413d1c0 con 0x7f9a2413fb60 2024-05-09T07:54:34.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.378+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a240691f0 con 0x7f9a2413fb60 2024-05-09T07:54:34.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.379+0000 7f9a1affd640 1 -- 172.21.15.87:0/2851397411 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a1401b070 con 0x7f9a2413fb60 2024-05-09T07:54:34.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.379+0000 7f9a1affd640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9a0806be60 0x7f9a0806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.379+0000 7f9a1affd640 1 -- 172.21.15.87:0/2851397411 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9a14089cf0 con 0x7f9a2413fb60 2024-05-09T07:54:34.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.379+0000 7f9a2a2b9640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9a0806be60 0x7f9a0806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.379+0000 7f9a2a2b9640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9a0806be60 0x7f9a0806e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a200098f0 tx=0x7f9a20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:34.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.383+0000 7f9a1affd640 1 -- 172.21.15.87:0/2851397411 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9a1408e070 con 0x7f9a2413fb60 2024-05-09T07:54:34.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.559+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9a2413f550 con 0x7f9a2413fb60 2024-05-09T07:54:34.574 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.560+0000 7f9a1affd640 1 -- 172.21.15.87:0/2851397411 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f9a14058a80 con 0x7f9a2413fb60 2024-05-09T07:54:34.575 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:34.575 INFO:teuthology.orchestra.run.smithi087.stdout:[ 2024-05-09T07:54:34.575 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T07:54:34.575 INFO:teuthology.orchestra.run.smithi087.stdout: "poolnum": 1, 2024-05-09T07:54:34.575 INFO:teuthology.orchestra.run.smithi087.stdout: "poolname": ".mgr" 2024-05-09T07:54:34.575 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T07:54:34.575 INFO:teuthology.orchestra.run.smithi087.stdout:] 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9a0806be60 msgr2=0x7f9a0806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9a0806be60 0x7f9a0806e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a200098f0 tx=0x7f9a20008040 comp rx=0 tx=0).stop 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 msgr2=0x7f9a2413e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 0x7f9a2413e740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400c460 tx=0x7f9a1400c920 comp rx=0 tx=0).stop 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 shutdown_connections 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9a0806be60 0x7f9a0806e320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a24149280 0x7f9a24135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a2413fb60 0x7f9a2413e740 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 --2- 172.21.15.87:0/2851397411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a240b5e60 0x7f9a241de650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 >> 172.21.15.87:0/2851397411 conn(0x7f9a2406c6a0 msgr2=0x7f9a24074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 shutdown_connections 2024-05-09T07:54:34.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.562+0000 7f9a2c51d640 1 -- 172.21.15.87:0/2851397411 wait complete. 2024-05-09T07:54:34.587 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T07:54:34.587 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.676+0000 7f6ae4c09640 1 Processor -- start 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.676+0000 7f6ae4c09640 1 -- start start 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6ae4c09640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ae0067200 0x7f6ae0147890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6ae4c09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae00b55f0 0x7f6ae0147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6ae4c09640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae00675e0 con 0x7f6ae014ae00 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6ae4c09640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae0148310 con 0x7f6ae0067200 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6ae4c09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae00b4500 con 0x7f6ae00b55f0 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6aded9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6ae014ae00 0x7f6ae014b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38972/0 (socket says 172.21.15.87:38972) 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6aded9d640 1 -- 172.21.15.87:0/3271788245 learned_addr learned my addr 172.21.15.87:0/3271788245 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6ad7fff640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae00b55f0 0x7f6ae0147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6ade59c640 1 --2- 172.21.15.87:0/3271788245 >> v2:172.21.15.110:3300/0 conn(0x7f6ae0067200 0x7f6ae0147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127493429 0 0) 0x7f6ae00675e0 con 0x7f6ae014ae00 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6acc003520 con 0x7f6ae014ae00 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3387031734 0 0) 0x7f6acc003520 con 0x7f6ae014ae00 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae00b55f0 msgr2=0x7f6ae0147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae00b55f0 0x7f6ae0147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 >> v2:172.21.15.110:3300/0 conn(0x7f6ae0067200 msgr2=0x7f6ae0147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 --2- 172.21.15.87:0/3271788245 >> v2:172.21.15.110:3300/0 conn(0x7f6ae0067200 0x7f6ae0147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae00aec10 con 0x7f6ae014ae00 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f6ad80019f0 con 0x7f6ae014ae00 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 >> v1:172.21.15.87:6789/0 conn(0x7f6ae014ae00 legacy=0x7f6ae014b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0039b0 0x7f6acc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc004310 0x7f6acc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc004e50 0x7f6acc0052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae00b4500 con 0x7f6acc004310 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6acc00bd60 con 0x7f6acc004e50 2024-05-09T07:54:34.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6acc00bf60 con 0x7f6acc0039b0 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6ad7fff640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc004310 0x7f6acc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6aded9d640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc004e50 0x7f6acc0052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.677+0000 7f6ade59c640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0039b0 0x7f6acc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6ad7fff640 1 -- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0039b0 msgr2=0x7f6acc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6ad7fff640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0039b0 0x7f6acc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6ad7fff640 1 -- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc004e50 msgr2=0x7f6acc0052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6ad7fff640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc004e50 0x7f6acc0052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6ad7fff640 1 -- 172.21.15.87:0/3271788245 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6acc003520 con 0x7f6acc004310 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6ade59c640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0039b0 0x7f6acc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6ad7fff640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc004310 0x7f6acc004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009ac0 tx=0x7f6acc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160c55472f349570 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8036070 con 0x7f6acc004310 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac8031400 con 0x7f6acc004310 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.678+0000 7f6addd9b640 1 -- 172.21.15.87:0/3271788245 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8009690 con 0x7f6acc004310 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.679+0000 7f6ae4c09640 1 -- 172.21.15.87:0/3271788245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc004310 msgr2=0x7f6acc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.679+0000 7f6ae4c09640 1 --2- 172.21.15.87:0/3271788245 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6acc004310 0x7f6acc004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009ac0 tx=0x7f6acc005830 comp rx=0 tx=0).stop 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.679+0000 7f6aded9d640 1 -- 172.21.15.87:0/3271788245 reap_dead start 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.679+0000 7f6ae4c09640 1 -- 172.21.15.87:0/3271788245 shutdown_connections 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.679+0000 7f6ae4c09640 1 -- 172.21.15.87:0/3271788245 >> 172.21.15.87:0/3271788245 conn(0x7f6ae00b94b0 msgr2=0x7f6ae00b98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.679+0000 7f6ae4c09640 1 -- 172.21.15.87:0/3271788245 shutdown_connections 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.679+0000 7f6ae4c09640 1 -- 172.21.15.87:0/3271788245 wait complete. 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.680+0000 7f6ae4c09640 1 Processor -- start 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.680+0000 7f6ae4c09640 1 -- start start 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ae4c09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc004310 0x7f6ae009caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ae4c09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae01dfef0 0x7f6ae01e0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ae4c09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae01dc960 0x7f6ae01dce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ae4c09640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae00b4190 con 0x7f6ae01dc960 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ae4c09640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae00b4c90 con 0x7f6ae01dfef0 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ae4c09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae009bed0 con 0x7f6acc004310 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6aded9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae01dc960 0x7f6ae01dce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6aded9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae01dc960 0x7f6ae01dce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47220/0 (socket says 172.21.15.87:47220) 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6aded9d640 1 -- 172.21.15.87:0/285429871 learned_addr learned my addr 172.21.15.87:0/285429871 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ade59c640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc004310 0x7f6ae009caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ad7fff640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae01dfef0 0x7f6ae01e0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6aded9d640 1 -- 172.21.15.87:0/285429871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc004310 msgr2=0x7f6ae009caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6aded9d640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc004310 0x7f6ae009caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6aded9d640 1 -- 172.21.15.87:0/285429871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae01dfef0 msgr2=0x7f6ae01e0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6aded9d640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae01dfef0 0x7f6ae01e0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6aded9d640 1 -- 172.21.15.87:0/285429871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae009f1c0 con 0x7f6ae01dc960 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ad7fff640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae01dfef0 0x7f6ae01e0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6aded9d640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae01dc960 0x7f6ae01dce10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00ba060 tx=0x7f6ad8007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ad6ffd640 1 -- 172.21.15.87:0/285429871 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800ace0 con 0x7f6ae01dc960 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ad6ffd640 1 -- 172.21.15.87:0/285429871 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad8018070 con 0x7f6ae01dc960 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae009f430 con 0x7f6ae01dc960 2024-05-09T07:54:34.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ad6ffd640 1 -- 172.21.15.87:0/285429871 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8013630 con 0x7f6ae01dc960 2024-05-09T07:54:34.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.681+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae009e250 con 0x7f6ae01dc960 2024-05-09T07:54:34.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.682+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae009e450 con 0x7f6ae01dc960 2024-05-09T07:54:34.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.683+0000 7f6ad6ffd640 1 -- 172.21.15.87:0/285429871 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ad80137d0 con 0x7f6ae01dc960 2024-05-09T07:54:34.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.683+0000 7f6ad6ffd640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6ac006be60 0x7f6ac006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:34.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.683+0000 7f6ade59c640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6ac006be60 0x7f6ac006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:34.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.683+0000 7f6ad6ffd640 1 -- 172.21.15.87:0/285429871 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6ad808b020 con 0x7f6ae01dc960 2024-05-09T07:54:34.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.684+0000 7f6ade59c640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6ac006be60 0x7f6ac006e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0006f80 tx=0x7f6ad0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:34.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.687+0000 7f6ad6ffd640 1 -- 172.21.15.87:0/285429871 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6ae009e450 con 0x7f6ae01dc960 2024-05-09T07:54:34.875 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:34.861+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6ae00691f0 con 0x7f6ae01dc960 2024-05-09T07:54:35.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.078+0000 7f6ad6ffd640 1 -- 172.21.15.87:0/285429871 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f6ad8059db0 con 0x7f6ae01dc960 2024-05-09T07:54:35.093 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' created 2024-05-09T07:54:35.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6ac006be60 msgr2=0x7f6ac006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:35.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6ac006be60 0x7f6ac006e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0006f80 tx=0x7f6ad0008040 comp rx=0 tx=0).stop 2024-05-09T07:54:35.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae01dc960 msgr2=0x7f6ae01dce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:35.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae01dc960 0x7f6ae01dce10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00ba060 tx=0x7f6ad8007bd0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 shutdown_connections 2024-05-09T07:54:35.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6ac006be60 0x7f6ac006e320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ae01dc960 0x7f6ae01dce10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae01dfef0 0x7f6ae01e0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 --2- 172.21.15.87:0/285429871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc004310 0x7f6ae009caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 >> 172.21.15.87:0/285429871 conn(0x7f6ae00b94b0 msgr2=0x7f6ae00b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:35.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 shutdown_connections 2024-05-09T07:54:35.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.080+0000 7f6ae4c09640 1 -- 172.21.15.87:0/285429871 wait complete. 2024-05-09T07:54:35.110 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T07:54:35.217 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.203+0000 7f8b4431d640 1 Processor -- start 2024-05-09T07:54:35.218 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.203+0000 7f8b4431d640 1 -- start start 2024-05-09T07:54:35.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b4431d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b3c0b39d0 0x7f8b3c0b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:35.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b4431d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b3c0b23b0 0x7f8b3c148330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:35.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b4431d640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b3c0b3db0 con 0x7f8b3c0b0260 2024-05-09T07:54:35.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b4431d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8b3c0af8d0 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b4431d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8b3c0b2800 con 0x7f8b3c0b23b0 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b420b9640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b3c0b39d0 0x7f8b3c0b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b418b8640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f8b3c0b0260 0x7f8b3c147c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38980/0 (socket says 172.21.15.87:38980) 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b418b8640 1 -- 172.21.15.87:0/2383770015 learned_addr learned my addr 172.21.15.87:0/2383770015 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b428ba640 1 --2- 172.21.15.87:0/2383770015 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c0b23b0 0x7f8b3c148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b420b9640 1 -- 172.21.15.87:0/2383770015 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c0b23b0 msgr2=0x7f8b3c148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b420b9640 1 --2- 172.21.15.87:0/2383770015 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c0b23b0 0x7f8b3c148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b420b9640 1 -- 172.21.15.87:0/2383770015 >> v1:172.21.15.87:6789/0 conn(0x7f8b3c0b0260 legacy=0x7f8b3c147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b420b9640 1 -- 172.21.15.87:0/2383770015 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c0afb20 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.204+0000 7f8b428ba640 1 --2- 172.21.15.87:0/2383770015 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c0b23b0 0x7f8b3c148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b420b9640 1 --2- 172.21.15.87:0/2383770015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 0x7f8b3c0b1e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0729e0 tx=0x7f8b3802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e83ff1f3db6f9b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b410b7640 1 -- 172.21.15.87:0/2383770015 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b38037070 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b410b7640 1 -- 172.21.15.87:0/2383770015 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b38032440 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b410b7640 1 -- 172.21.15.87:0/2383770015 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3802ae60 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b4431d640 1 -- 172.21.15.87:0/2383770015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 msgr2=0x7f8b3c0b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:35.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b4431d640 1 --2- 172.21.15.87:0/2383770015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 0x7f8b3c0b1e70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0729e0 tx=0x7f8b3802a110 comp rx=0 tx=0).stop 2024-05-09T07:54:35.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b4431d640 1 -- 172.21.15.87:0/2383770015 shutdown_connections 2024-05-09T07:54:35.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b4431d640 1 --2- 172.21.15.87:0/2383770015 >> v2:172.21.15.110:3300/0 conn(0x7f8b3c0b23b0 0x7f8b3c148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b4431d640 1 --2- 172.21.15.87:0/2383770015 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 0x7f8b3c0b1e70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b4431d640 1 -- 172.21.15.87:0/2383770015 >> 172.21.15.87:0/2383770015 conn(0x7f8b3c0b5860 msgr2=0x7f8b3c0b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:35.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.205+0000 7f8b4431d640 1 -- 172.21.15.87:0/2383770015 shutdown_connections 2024-05-09T07:54:35.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.206+0000 7f8b4431d640 1 -- 172.21.15.87:0/2383770015 wait complete. 2024-05-09T07:54:35.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.206+0000 7f8b4431d640 1 Processor -- start 2024-05-09T07:54:35.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.206+0000 7f8b4431d640 1 -- start start 2024-05-09T07:54:35.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b4431d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3c0b0260 0x7f8b3c1d1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:35.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b4431d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b3c0b23b0 0x7f8b3c1e0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:35.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b4431d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 0x7f8b3c1cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:35.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b4431d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c1489f0 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b4431d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c148870 con 0x7f8b3c0b23b0 2024-05-09T07:54:35.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b4431d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3c06d7f0 con 0x7f8b3c0b0260 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b428ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 0x7f8b3c1cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b428ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 0x7f8b3c1cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47228/0 (socket says 172.21.15.87:47228) 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b428ba640 1 -- 172.21.15.87:0/3531450278 learned_addr learned my addr 172.21.15.87:0/3531450278 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b418b8640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b3c0b23b0 0x7f8b3c1e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b420b9640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3c0b0260 0x7f8b3c1d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b428ba640 1 -- 172.21.15.87:0/3531450278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3c0b0260 msgr2=0x7f8b3c1d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b428ba640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3c0b0260 0x7f8b3c1d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b428ba640 1 -- 172.21.15.87:0/3531450278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b3c0b23b0 msgr2=0x7f8b3c1e0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b428ba640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b3c0b23b0 0x7f8b3c1e0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:35.226 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.207+0000 7f8b428ba640 1 -- 172.21.15.87:0/3531450278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c0b3ff0 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.208+0000 7f8b428ba640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 0x7f8b3c1cfc20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009fa0 tx=0x7f8b3400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:35.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.208+0000 7f8b32ffd640 1 -- 172.21.15.87:0/3531450278 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3401a070 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.208+0000 7f8b32ffd640 1 -- 172.21.15.87:0/3531450278 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b34003bb0 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.208+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3c0b47d0 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.208+0000 7f8b32ffd640 1 -- 172.21.15.87:0/3531450278 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34004030 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.208+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3c0b42b0 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.209+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b3c0b44b0 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.209+0000 7f8b32ffd640 1 -- 172.21.15.87:0/3531450278 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b3401d070 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.210+0000 7f8b32ffd640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b2006be60 0x7f8b2006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:35.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.210+0000 7f8b420b9640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b2006be60 0x7f8b2006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:35.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.210+0000 7f8b32ffd640 1 -- 172.21.15.87:0/3531450278 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f8b3408ae40 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.210+0000 7f8b420b9640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b2006be60 0x7f8b2006e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b38034000 tx=0x7f8b3802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:35.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.215+0000 7f8b32ffd640 1 -- 172.21.15.87:0/3531450278 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8b3c0b44b0 con 0x7f8b3c0b39d0 2024-05-09T07:54:35.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:35.387+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8b3c0691f0 con 0x7f8b3c0b39d0 2024-05-09T07:54:36.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.082+0000 7f8b32ffd640 1 -- 172.21.15.87:0/3531450278 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f8b34010070 con 0x7f8b3c0b39d0 2024-05-09T07:54:36.097 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' created 2024-05-09T07:54:36.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b2006be60 msgr2=0x7f8b2006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:36.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b2006be60 0x7f8b2006e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b38034000 tx=0x7f8b3802e000 comp rx=0 tx=0).stop 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 msgr2=0x7f8b3c1cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 0x7f8b3c1cfc20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009fa0 tx=0x7f8b3400d560 comp rx=0 tx=0).stop 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 shutdown_connections 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b2006be60 0x7f8b2006e320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b3c0b39d0 0x7f8b3c1cfc20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b3c0b23b0 0x7f8b3c1e0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 --2- 172.21.15.87:0/3531450278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3c0b0260 0x7f8b3c1d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.084+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 >> 172.21.15.87:0/3531450278 conn(0x7f8b3c0b5860 msgr2=0x7f8b3c0b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.085+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 shutdown_connections 2024-05-09T07:54:36.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.085+0000 7f8b4431d640 1 -- 172.21.15.87:0/3531450278 wait complete. 2024-05-09T07:54:36.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T07:54:36.221 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.207+0000 7fcf5c91b640 1 Processor -- start 2024-05-09T07:54:36.222 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.207+0000 7fcf5c91b640 1 -- start start 2024-05-09T07:54:36.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.207+0000 7fcf5c91b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcf580ae490 0x7fcf58146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:36.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.207+0000 7fcf5c91b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf58147100 0x7fcf581475b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.207+0000 7fcf5c91b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf580b15a0 con 0x7fcf580b39d0 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.207+0000 7fcf5c91b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fcf580b3db0 con 0x7fcf580ae490 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.207+0000 7fcf5c91b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fcf580af940 con 0x7fcf58147100 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf58147100 0x7fcf581475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf55d9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcf580ae490 0x7fcf58146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf5659c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcf580b39d0 0x7fcf580add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:56080/0 (socket says 172.21.15.87:56080) 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf55d9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcf580ae490 0x7fcf58146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:34732/0 (socket says 172.21.15.87:34732) 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf5659c640 1 -- 172.21.15.87:0/334119563 learned_addr learned my addr 172.21.15.87:0/334119563 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf58147100 0x7fcf581475b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:44928/0 (socket says 172.21.15.87:44928) 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf5559a640 1 -- 172.21.15.87:0/334119563 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 15784087 0 0) 0x7fcf580b15a0 con 0x7fcf580b39d0 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf5559a640 1 -- 172.21.15.87:0/334119563 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf44003520 con 0x7fcf580b39d0 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf55d9b640 1 -- 172.21.15.87:0/334119563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf58147100 msgr2=0x7fcf581475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf55d9b640 1 --2- 172.21.15.87:0/334119563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf58147100 0x7fcf581475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf55d9b640 1 -- 172.21.15.87:0/334119563 >> v1:172.21.15.110:6789/0 conn(0x7fcf580b39d0 legacy=0x7fcf580add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:36.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf55d9b640 1 -- 172.21.15.87:0/334119563 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf580afd90 con 0x7fcf580ae490 2024-05-09T07:54:36.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.208+0000 7fcf56d9d640 1 --2- 172.21.15.87:0/334119563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf58147100 0x7fcf581475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:36.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.209+0000 7fcf55d9b640 1 --2- 172.21.15.87:0/334119563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 0x7fcf58146bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcf400097a0 tx=0x7fcf4002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c18901800d624602 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:36.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.209+0000 7fcf5559a640 1 -- 172.21.15.87:0/334119563 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40037070 con 0x7fcf580ae490 2024-05-09T07:54:36.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.209+0000 7fcf5559a640 1 -- 172.21.15.87:0/334119563 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4002ae50 con 0x7fcf580ae490 2024-05-09T07:54:36.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.209+0000 7fcf5559a640 1 -- 172.21.15.87:0/334119563 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40032640 con 0x7fcf580ae490 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.210+0000 7fcf5c91b640 1 -- 172.21.15.87:0/334119563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 msgr2=0x7fcf58146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.210+0000 7fcf5c91b640 1 --2- 172.21.15.87:0/334119563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 0x7fcf58146bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcf400097a0 tx=0x7fcf4002a100 comp rx=0 tx=0).stop 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.210+0000 7fcf5c91b640 1 -- 172.21.15.87:0/334119563 shutdown_connections 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.210+0000 7fcf5c91b640 1 --2- 172.21.15.87:0/334119563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf58147100 0x7fcf581475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.210+0000 7fcf5c91b640 1 --2- 172.21.15.87:0/334119563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 0x7fcf58146bc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.210+0000 7fcf5c91b640 1 -- 172.21.15.87:0/334119563 >> 172.21.15.87:0/334119563 conn(0x7fcf580b5860 msgr2=0x7fcf580b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.210+0000 7fcf5c91b640 1 -- 172.21.15.87:0/334119563 shutdown_connections 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.210+0000 7fcf5c91b640 1 -- 172.21.15.87:0/334119563 wait complete. 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.211+0000 7fcf5c91b640 1 Processor -- start 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.211+0000 7fcf5c91b640 1 -- start start 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.211+0000 7fcf5c91b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 0x7fcf58070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:36.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.211+0000 7fcf5c91b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf580b39d0 0x7fcf5814c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.211+0000 7fcf5c91b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf58147100 0x7fcf5814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.211+0000 7fcf5c91b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5806d9b0 con 0x7fcf58147100 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.211+0000 7fcf5c91b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5806d830 con 0x7fcf580ae490 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.211+0000 7fcf5c91b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5814f180 con 0x7fcf580b39d0 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf58147100 0x7fcf5814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf56d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf58147100 0x7fcf5814bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47244/0 (socket says 172.21.15.87:47244) 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf56d9d640 1 -- 172.21.15.87:0/1590469680 learned_addr learned my addr 172.21.15.87:0/1590469680 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf5659c640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 0x7fcf58070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf55d9b640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf580b39d0 0x7fcf5814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf56d9d640 1 -- 172.21.15.87:0/1590469680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf580b39d0 msgr2=0x7fcf5814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf56d9d640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf580b39d0 0x7fcf5814c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf56d9d640 1 -- 172.21.15.87:0/1590469680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 msgr2=0x7fcf58070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf56d9d640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 0x7fcf58070020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:36.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf56d9d640 1 -- 172.21.15.87:0/1590469680 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5814cf40 con 0x7fcf58147100 2024-05-09T07:54:36.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf5659c640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 0x7fcf58070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:36.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf56d9d640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf58147100 0x7fcf5814bd00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800e930 tx=0x7fcf4800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:36.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf4effd640 1 -- 172.21.15.87:0/1590469680 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48017070 con 0x7fcf58147100 2024-05-09T07:54:36.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf4effd640 1 -- 172.21.15.87:0/1590469680 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4800ca00 con 0x7fcf58147100 2024-05-09T07:54:36.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5814d220 con 0x7fcf58147100 2024-05-09T07:54:36.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf4effd640 1 -- 172.21.15.87:0/1590469680 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800cdd0 con 0x7fcf58147100 2024-05-09T07:54:36.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.212+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5814e280 con 0x7fcf58147100 2024-05-09T07:54:36.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.213+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf580691f0 con 0x7fcf58147100 2024-05-09T07:54:36.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.214+0000 7fcf4effd640 1 -- 172.21.15.87:0/1590469680 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf48013470 con 0x7fcf58147100 2024-05-09T07:54:36.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.214+0000 7fcf4effd640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcf3806be30 0x7fcf3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:36.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.214+0000 7fcf5659c640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcf3806be30 0x7fcf3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:36.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.214+0000 7fcf4effd640 1 -- 172.21.15.87:0/1590469680 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fcf4808abf0 con 0x7fcf58147100 2024-05-09T07:54:36.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.215+0000 7fcf5659c640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcf3806be30 0x7fcf3806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf50002230 tx=0x7fcf50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:36.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.219+0000 7fcf4effd640 1 -- 172.21.15.87:0/1590469680 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fcf48059100 con 0x7fcf58147100 2024-05-09T07:54:36.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:36.427+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcf5809edb0 con 0x7fcf58147100 2024-05-09T07:54:37.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.089+0000 7fcf4effd640 1 -- 172.21.15.87:0/1590469680 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fcf4805d400 con 0x7fcf58147100 2024-05-09T07:54:37.104 INFO:teuthology.orchestra.run.smithi087.stderr:new fs with metadata pool 2 and data pool 3 2024-05-09T07:54:37.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.098+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcf3806be30 msgr2=0x7fcf3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.098+0000 7fcf5c91b640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcf3806be30 0x7fcf3806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf50002230 tx=0x7fcf50009040 comp rx=0 tx=0).stop 2024-05-09T07:54:37.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.098+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf58147100 msgr2=0x7fcf5814bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.098+0000 7fcf5c91b640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf58147100 0x7fcf5814bd00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800e930 tx=0x7fcf4800edf0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.103+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 shutdown_connections 2024-05-09T07:54:37.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.103+0000 7fcf5c91b640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcf3806be30 0x7fcf3806e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.103+0000 7fcf5c91b640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf580b39d0 0x7fcf5814c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.103+0000 7fcf5c91b640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcf58147100 0x7fcf5814bd00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.103+0000 7fcf5c91b640 1 --2- 172.21.15.87:0/1590469680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580ae490 0x7fcf58070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.103+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 >> 172.21.15.87:0/1590469680 conn(0x7fcf580b5860 msgr2=0x7fcf580b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:37.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.108+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 shutdown_connections 2024-05-09T07:54:37.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.108+0000 7fcf5c91b640 1 -- 172.21.15.87:0/1590469680 wait complete. 2024-05-09T07:54:37.140 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:37.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.227+0000 7f58b2aa3640 1 Processor -- start 2024-05-09T07:54:37.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.227+0000 7f58b2aa3640 1 -- start start 2024-05-09T07:54:37.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.228+0000 7f58b2aa3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58ac0b5a10 0x7f58ac147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.228+0000 7f58b2aa3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac148180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.228+0000 7f58b2aa3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58ac0af330 con 0x7f58ac0b5630 2024-05-09T07:54:37.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.228+0000 7f58b2aa3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f58ac073150 con 0x7f58ac0b5a10 2024-05-09T07:54:37.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.228+0000 7f58b2aa3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f58ac0afe00 con 0x7f58ac0b0290 2024-05-09T07:54:37.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.228+0000 7f58abfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58ac0b5a10 0x7f58ac147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.228+0000 7f58b1040640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.228+0000 7f58b083f640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f58ac0b5630 0x7f58ac06b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:56088/0 (socket says 172.21.15.87:56088) 2024-05-09T07:54:37.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.228+0000 7f58b083f640 1 -- 172.21.15.87:0/2801462317 learned_addr learned my addr 172.21.15.87:0/2801462317 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:37.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.229+0000 7f58abfff640 1 -- 172.21.15.87:0/2801462317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 msgr2=0x7f58ac148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:37.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.229+0000 7f58abfff640 1 --2- 172.21.15.87:0/2801462317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.229+0000 7f58abfff640 1 -- 172.21.15.87:0/2801462317 >> v1:172.21.15.110:6789/0 conn(0x7f58ac0b5630 legacy=0x7f58ac06b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.229+0000 7f58abfff640 1 -- 172.21.15.87:0/2801462317 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac06e9e0 con 0x7f58ac0b5a10 2024-05-09T07:54:37.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.229+0000 7f58ab7fe640 1 -- 172.21.15.87:0/2801462317 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674601368 0 0) 0x7f58ac0af330 con 0x7f58ac0b5630 2024-05-09T07:54:37.247 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.229+0000 7f58b1040640 1 --2- 172.21.15.87:0/2801462317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:37.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.229+0000 7f58abfff640 1 --2- 172.21.15.87:0/2801462317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac0b5a10 0x7f58ac147c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58a00097a0 tx=0x7f58a002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5daad35d7d8b5834 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:37.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58ab7fe640 1 -- 172.21.15.87:0/2801462317 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0037070 con 0x7f58ac0b5a10 2024-05-09T07:54:37.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58ab7fe640 1 -- 172.21.15.87:0/2801462317 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a0032440 con 0x7f58ac0b5a10 2024-05-09T07:54:37.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58ab7fe640 1 -- 172.21.15.87:0/2801462317 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0032810 con 0x7f58ac0b5a10 2024-05-09T07:54:37.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58b2aa3640 1 -- 172.21.15.87:0/2801462317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac0b5a10 msgr2=0x7f58ac147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58b2aa3640 1 --2- 172.21.15.87:0/2801462317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac0b5a10 0x7f58ac147c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58a00097a0 tx=0x7f58a002a180 comp rx=0 tx=0).stop 2024-05-09T07:54:37.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58b2aa3640 1 -- 172.21.15.87:0/2801462317 shutdown_connections 2024-05-09T07:54:37.248 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58b2aa3640 1 --2- 172.21.15.87:0/2801462317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58b2aa3640 1 --2- 172.21.15.87:0/2801462317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac0b5a10 0x7f58ac147c40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58b2aa3640 1 -- 172.21.15.87:0/2801462317 >> 172.21.15.87:0/2801462317 conn(0x7f58ac0b68e0 msgr2=0x7f58ac0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:37.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58b2aa3640 1 -- 172.21.15.87:0/2801462317 shutdown_connections 2024-05-09T07:54:37.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.230+0000 7f58b2aa3640 1 -- 172.21.15.87:0/2801462317 wait complete. 2024-05-09T07:54:37.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.231+0000 7f58b2aa3640 1 Processor -- start 2024-05-09T07:54:37.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.231+0000 7f58b2aa3640 1 -- start start 2024-05-09T07:54:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b2aa3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b2aa3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac0b5630 0x7f58ac14a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b2aa3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58ac0b5a10 0x7f58ac14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b2aa3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac0b6540 con 0x7f58ac0b5a10 2024-05-09T07:54:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b2aa3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac0af050 con 0x7f58ac0b5630 2024-05-09T07:54:37.253 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b2aa3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f58ac0b4880 con 0x7f58ac0b0290 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b1040640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58ac0b5a10 0x7f58ac14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b1040640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58ac0b5a10 0x7f58ac14a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47248/0 (socket says 172.21.15.87:47248) 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b1040640 1 -- 172.21.15.87:0/1897609644 learned_addr learned my addr 172.21.15.87:0/1897609644 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58abfff640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac0b5630 0x7f58ac14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b083f640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b1040640 1 -- 172.21.15.87:0/1897609644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 msgr2=0x7f58ac142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b1040640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b1040640 1 -- 172.21.15.87:0/1897609644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac0b5630 msgr2=0x7f58ac14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b1040640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac0b5630 0x7f58ac14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b1040640 1 -- 172.21.15.87:0/1897609644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac1dd840 con 0x7f58ac0b5a10 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b083f640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.232+0000 7f58b1040640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58ac0b5a10 0x7f58ac14a9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58a400e880 tx=0x7f58a400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.233+0000 7f58a97fa640 1 -- 172.21.15.87:0/1897609644 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4017070 con 0x7f58ac0b5a10 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.233+0000 7f58a97fa640 1 -- 172.21.15.87:0/1897609644 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a4004020 con 0x7f58ac0b5a10 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.233+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac1ddae0 con 0x7f58ac0b5a10 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.233+0000 7f58a97fa640 1 -- 172.21.15.87:0/1897609644 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a40043f0 con 0x7f58ac0b5a10 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.233+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac0b1140 con 0x7f58ac0b5a10 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.234+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ac0691f0 con 0x7f58ac0b5a10 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.234+0000 7f58a97fa640 1 -- 172.21.15.87:0/1897609644 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58a400c940 con 0x7f58ac0b5a10 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.234+0000 7f58a97fa640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f589806be30 0x7f589806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.255 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.235+0000 7f58b083f640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f589806be30 0x7f589806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.235+0000 7f58a97fa640 1 -- 172.21.15.87:0/1897609644 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58a408ab10 con 0x7f58ac0b5a10 2024-05-09T07:54:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.235+0000 7f58b083f640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f589806be30 0x7f589806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f589c0012e0 tx=0x7f589c007f90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:37.256 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.239+0000 7f58a97fa640 1 -- 172.21.15.87:0/1897609644 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f58a4058f00 con 0x7f58ac0b5a10 2024-05-09T07:54:37.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.411+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58ac068d50 con 0x7f58ac0b5a10 2024-05-09T07:54:37.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.412+0000 7f58a97fa640 1 -- 172.21.15.87:0/1897609644 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16594 (secure 0 0 0) 0x7f58a405d200 con 0x7f58ac0b5a10 2024-05-09T07:54:37.427 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:37.427 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:36.428178+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f589806be30 msgr2=0x7f589806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f589806be30 0x7f589806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f589c0012e0 tx=0x7f589c007f90 comp rx=0 tx=0).stop 2024-05-09T07:54:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58ac0b5a10 msgr2=0x7f58ac14a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58ac0b5a10 0x7f58ac14a9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58a400e880 tx=0x7f58a400ed40 comp rx=0 tx=0).stop 2024-05-09T07:54:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 shutdown_connections 2024-05-09T07:54:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f589806be30 0x7f589806e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f58ac0b5a10 0x7f58ac14a9c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58ac0b5630 0x7f58ac14a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 --2- 172.21.15.87:0/1897609644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58ac0b0290 0x7f58ac142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 >> 172.21.15.87:0/1897609644 conn(0x7f58ac0b68e0 msgr2=0x7f58ac09f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:37.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 shutdown_connections 2024-05-09T07:54:37.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.414+0000 7f58b2aa3640 1 -- 172.21.15.87:0/1897609644 wait complete. 2024-05-09T07:54:37.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:37.542 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff116029640 1 Processor -- start 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff116029640 1 -- start start 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff116029640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff1100b5e20 0x7ff110147720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff116029640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff110141c90 0x7ff110152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff116029640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1100b5900 con 0x7ff1100b3e30 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff116029640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ff1100b50c0 con 0x7ff1100b5e20 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff116029640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff1100b4a70 con 0x7ff110141c90 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff10f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff1100b5e20 0x7ff110147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff107fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff1100b3e30 0x7ff110141580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:38988/0 (socket says 172.21.15.87:38988) 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff107fff640 1 -- 172.21.15.87:0/2108245738 learned_addr learned my addr 172.21.15.87:0/2108245738 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.527+0000 7ff10f7fe640 1 --2- 172.21.15.87:0/2108245738 >> v2:172.21.15.87:3300/0 conn(0x7ff1100b5e20 0x7ff110147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47258/0 (socket says 172.21.15.87:47258) 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.528+0000 7ff10ffff640 1 --2- 172.21.15.87:0/2108245738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff110141c90 0x7ff110152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.543 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.528+0000 7ff10f7fe640 1 -- 172.21.15.87:0/2108245738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff110141c90 msgr2=0x7ff110152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:37.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.528+0000 7ff10f7fe640 1 --2- 172.21.15.87:0/2108245738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff110141c90 0x7ff110152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.528+0000 7ff10f7fe640 1 -- 172.21.15.87:0/2108245738 >> v1:172.21.15.87:6789/0 conn(0x7ff1100b3e30 legacy=0x7ff110141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.528+0000 7ff10f7fe640 1 -- 172.21.15.87:0/2108245738 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1100b4d50 con 0x7ff1100b5e20 2024-05-09T07:54:37.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.528+0000 7ff10effd640 1 -- 172.21.15.87:0/2108245738 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 672612667 0 0) 0x7ff1100b5900 con 0x7ff1100b3e30 2024-05-09T07:54:37.544 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.528+0000 7ff10ffff640 1 --2- 172.21.15.87:0/2108245738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff110141c90 0x7ff110152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.528+0000 7ff10f7fe640 1 --2- 172.21.15.87:0/2108245738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b5e20 0x7ff110147720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff100009790 tx=0x7ff10002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48979ca810fe919f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff10effd640 1 -- 172.21.15.87:0/2108245738 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100037070 con 0x7ff1100b5e20 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff10effd640 1 -- 172.21.15.87:0/2108245738 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff100032440 con 0x7ff1100b5e20 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff10effd640 1 -- 172.21.15.87:0/2108245738 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100032810 con 0x7ff1100b5e20 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff116029640 1 -- 172.21.15.87:0/2108245738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b5e20 msgr2=0x7ff110147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff116029640 1 --2- 172.21.15.87:0/2108245738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b5e20 0x7ff110147720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff100009790 tx=0x7ff10002a180 comp rx=0 tx=0).stop 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff116029640 1 -- 172.21.15.87:0/2108245738 shutdown_connections 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff116029640 1 --2- 172.21.15.87:0/2108245738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff110141c90 0x7ff110152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff116029640 1 --2- 172.21.15.87:0/2108245738 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b5e20 0x7ff110147720 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff116029640 1 -- 172.21.15.87:0/2108245738 >> 172.21.15.87:0/2108245738 conn(0x7ff1100676a0 msgr2=0x7ff1100bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff116029640 1 -- 172.21.15.87:0/2108245738 shutdown_connections 2024-05-09T07:54:37.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.529+0000 7ff116029640 1 -- 172.21.15.87:0/2108245738 wait complete. 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.530+0000 7ff116029640 1 Processor -- start 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.530+0000 7ff116029640 1 -- start start 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff116029640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b3e30 0x7ff1101dcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff116029640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1100b5e20 0x7ff11014b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff116029640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff110141c90 0x7ff1101499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff116029640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff1100b5550 con 0x7ff1100b3e30 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff116029640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff1100bdbc0 con 0x7ff110141c90 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff116029640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff110149f10 con 0x7ff1100b5e20 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b3e30 0x7ff1101dcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10f7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b3e30 0x7ff1101dcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47264/0 (socket says 172.21.15.87:47264) 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10f7fe640 1 -- 172.21.15.87:0/3996423358 learned_addr learned my addr 172.21.15.87:0/3996423358 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff107fff640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1100b5e20 0x7ff11014b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10ffff640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff110141c90 0x7ff1101499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10f7fe640 1 -- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1100b5e20 msgr2=0x7ff11014b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10f7fe640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1100b5e20 0x7ff11014b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10f7fe640 1 -- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff110141c90 msgr2=0x7ff1101499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10f7fe640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff110141c90 0x7ff1101499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10f7fe640 1 -- 172.21.15.87:0/3996423358 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11014a260 con 0x7ff1100b3e30 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff107fff640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1100b5e20 0x7ff11014b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10ffff640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff110141c90 0x7ff1101499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10f7fe640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b3e30 0x7ff1101dcde0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff100035040 tx=0x7ff1000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10cff9640 1 -- 172.21.15.87:0/3996423358 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100041020 con 0x7ff1100b3e30 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10cff9640 1 -- 172.21.15.87:0/3996423358 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff100030990 con 0x7ff1100b3e30 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1101d0cb0 con 0x7ff1100b3e30 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.531+0000 7ff10cff9640 1 -- 172.21.15.87:0/3996423358 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100037040 con 0x7ff1100b3e30 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.532+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11014a990 con 0x7ff1100b3e30 2024-05-09T07:54:37.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.532+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1100691f0 con 0x7ff1100b3e30 2024-05-09T07:54:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.533+0000 7ff10cff9640 1 -- 172.21.15.87:0/3996423358 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff100044020 con 0x7ff1100b3e30 2024-05-09T07:54:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.533+0000 7ff10cff9640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff0f006be60 0x7ff0f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.533+0000 7ff10cff9640 1 -- 172.21.15.87:0/3996423358 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff1000ab750 con 0x7ff1100b3e30 2024-05-09T07:54:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.533+0000 7ff107fff640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff0f006be60 0x7ff0f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.551 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.534+0000 7ff107fff640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff0f006be60 0x7ff0f006e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1100bd9e0 tx=0x7ff0f8007c10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:37.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.538+0000 7ff10cff9640 1 -- 172.21.15.87:0/3996423358 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff10004b030 con 0x7ff1100b3e30 2024-05-09T07:54:37.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.715+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1100bd730 con 0x7ff1100b3e30 2024-05-09T07:54:37.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.716+0000 7ff10cff9640 1 -- 172.21.15.87:0/3996423358 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16594 (secure 0 0 0) 0x7ff10007a190 con 0x7ff1100b3e30 2024-05-09T07:54:37.732 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:37.732 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":20,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:36.428178+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:37.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff0f006be60 msgr2=0x7ff0f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff0f006be60 0x7ff0f006e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1100bd9e0 tx=0x7ff0f8007c10 comp rx=0 tx=0).stop 2024-05-09T07:54:37.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b3e30 msgr2=0x7ff1101dcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b3e30 0x7ff1101dcde0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff100035040 tx=0x7ff1000046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 shutdown_connections 2024-05-09T07:54:37.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff0f006be60 0x7ff0f006e320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1100b5e20 0x7ff11014b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff110141c90 0x7ff1101499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 --2- 172.21.15.87:0/3996423358 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff1100b3e30 0x7ff1101dcde0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 >> 172.21.15.87:0/3996423358 conn(0x7ff1100676a0 msgr2=0x7ff1101478c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:37.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 shutdown_connections 2024-05-09T07:54:37.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.718+0000 7ff116029640 1 -- 172.21.15.87:0/3996423358 wait complete. 2024-05-09T07:54:37.744 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-09T07:54:37.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.833+0000 7f6245a12640 1 Processor -- start 2024-05-09T07:54:37.848 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.833+0000 7f6245a12640 1 -- start start 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f6245a12640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f62400b4dd0 0x7f62400b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f6245a12640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f62400b56f0 0x7f62401417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f6245a12640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62400b4780 con 0x7f6240141cf0 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f6245a12640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6240142120 con 0x7f62400b56f0 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f6245a12640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f62400b6090 con 0x7f62400b4dd0 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f623e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f62400b56f0 0x7f62401417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f623e7fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f62400b56f0 0x7f62401417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47270/0 (socket says 172.21.15.87:47270) 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f623e7fc640 1 -- 172.21.15.87:0/1798519730 learned_addr learned my addr 172.21.15.87:0/1798519730 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f623e7fc640 1 -- 172.21.15.87:0/1798519730 >> v2:172.21.15.110:3300/0 conn(0x7f62400b4dd0 msgr2=0x7f62400b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:37.851 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f623e7fc640 1 --2- 172.21.15.87:0/1798519730 >> v2:172.21.15.110:3300/0 conn(0x7f62400b4dd0 0x7f62400b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f623e7fc640 1 -- 172.21.15.87:0/1798519730 >> v1:172.21.15.110:6789/0 conn(0x7f6240141cf0 legacy=0x7f6240147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.834+0000 7f623e7fc640 1 -- 172.21.15.87:0/1798519730 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62400b5e20 con 0x7f62400b56f0 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.835+0000 7f623e7fc640 1 --2- 172.21.15.87:0/1798519730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b56f0 0x7f62401417b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62400be0c0 tx=0x7f623402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2905584417b6fd08 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.835+0000 7f623dffb640 1 -- 172.21.15.87:0/1798519730 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234037070 con 0x7f62400b56f0 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.835+0000 7f623dffb640 1 -- 172.21.15.87:0/1798519730 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6234032440 con 0x7f62400b56f0 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.835+0000 7f623dffb640 1 -- 172.21.15.87:0/1798519730 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234032810 con 0x7f62400b56f0 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.835+0000 7f6245a12640 1 -- 172.21.15.87:0/1798519730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b56f0 msgr2=0x7f62401417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.836+0000 7f6245a12640 1 --2- 172.21.15.87:0/1798519730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b56f0 0x7f62401417b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62400be0c0 tx=0x7f623402a1a0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.836+0000 7f6245a12640 1 -- 172.21.15.87:0/1798519730 shutdown_connections 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.836+0000 7f6245a12640 1 --2- 172.21.15.87:0/1798519730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b56f0 0x7f62401417b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.852 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.836+0000 7f6245a12640 1 --2- 172.21.15.87:0/1798519730 >> v2:172.21.15.110:3300/0 conn(0x7f62400b4dd0 0x7f62400b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.836+0000 7f6245a12640 1 -- 172.21.15.87:0/1798519730 >> 172.21.15.87:0/1798519730 conn(0x7f62400677b0 msgr2=0x7f62400bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:37.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.836+0000 7f6245a12640 1 -- 172.21.15.87:0/1798519730 shutdown_connections 2024-05-09T07:54:37.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.836+0000 7f6245a12640 1 -- 172.21.15.87:0/1798519730 wait complete. 2024-05-09T07:54:37.853 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f6245a12640 1 Processor -- start 2024-05-09T07:54:37.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f6245a12640 1 -- start start 2024-05-09T07:54:37.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f6245a12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b4dd0 0x7f6240142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.855 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f6245a12640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400b56f0 0x7f62401ddb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f6245a12640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6240141cf0 0x7f624013fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f6245a12640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f62400b4200 con 0x7f62400b4dd0 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f6245a12640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f62400b4080 con 0x7f6240141cf0 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f6245a12640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6240148400 con 0x7f62400b56f0 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f623effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b4dd0 0x7f6240142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f623effd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b4dd0 0x7f6240142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47278/0 (socket says 172.21.15.87:47278) 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.837+0000 7f623effd640 1 -- 172.21.15.87:0/1180178692 learned_addr learned my addr 172.21.15.87:0/1180178692 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f623effd640 1 -- 172.21.15.87:0/1180178692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400b56f0 msgr2=0x7f62401ddb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f623effd640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400b56f0 0x7f62401ddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f623effd640 1 -- 172.21.15.87:0/1180178692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6240141cf0 msgr2=0x7f624013fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f623effd640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6240141cf0 0x7f624013fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f623effd640 1 -- 172.21.15.87:0/1180178692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6240143500 con 0x7f62400b4dd0 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f623effd640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b4dd0 0x7f6240142e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f623000b4a0 tx=0x7f623000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f6227fff640 1 -- 172.21.15.87:0/1180178692 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230014070 con 0x7f62400b4dd0 2024-05-09T07:54:37.856 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f6227fff640 1 -- 172.21.15.87:0/1180178692 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6230010610 con 0x7f62400b4dd0 2024-05-09T07:54:37.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624013c330 con 0x7f62400b4dd0 2024-05-09T07:54:37.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f6227fff640 1 -- 172.21.15.87:0/1180178692 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230010a00 con 0x7f62400b4dd0 2024-05-09T07:54:37.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.838+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62401de040 con 0x7f62400b4dd0 2024-05-09T07:54:37.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.839+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62401dd410 con 0x7f62400b4dd0 2024-05-09T07:54:37.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.839+0000 7f6227fff640 1 -- 172.21.15.87:0/1180178692 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6230017070 con 0x7f62400b4dd0 2024-05-09T07:54:37.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.840+0000 7f6227fff640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f622c06be30 0x7f622c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:37.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.840+0000 7f623e7fc640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f622c06be30 0x7f622c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:37.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.840+0000 7f6227fff640 1 -- 172.21.15.87:0/1180178692 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f623008a860 con 0x7f62400b4dd0 2024-05-09T07:54:37.857 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.841+0000 7f623e7fc640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f622c06be30 0x7f622c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6234034000 tx=0x7f623402c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:37.859 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:37.844+0000 7f6227fff640 1 -- 172.21.15.87:0/1180178692 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f62300592a0 con 0x7f62400b4dd0 2024-05-09T07:54:38.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.055+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f62400691f0 con 0x7f62400b4dd0 2024-05-09T07:54:38.488 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.473+0000 7f6227fff640 1 -- 172.21.15.87:0/1180178692 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f623008a070 con 0x7f62400b4dd0 2024-05-09T07:54:38.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.476+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f622c06be30 msgr2=0x7f622c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.476+0000 7f6245a12640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f622c06be30 0x7f622c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6234034000 tx=0x7f623402c000 comp rx=0 tx=0).stop 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.476+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b4dd0 msgr2=0x7f6240142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.476+0000 7f6245a12640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b4dd0 0x7f6240142e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f623000b4a0 tx=0x7f623000b960 comp rx=0 tx=0).stop 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.477+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 shutdown_connections 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.477+0000 7f6245a12640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f622c06be30 0x7f622c06e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.477+0000 7f6245a12640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400b56f0 0x7f62401ddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.477+0000 7f6245a12640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6240141cf0 0x7f624013fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.477+0000 7f6245a12640 1 --2- 172.21.15.87:0/1180178692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f62400b4dd0 0x7f6240142e20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.477+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 >> 172.21.15.87:0/1180178692 conn(0x7f62400677b0 msgr2=0x7f6240074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.477+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 shutdown_connections 2024-05-09T07:54:38.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.477+0000 7f6245a12640 1 -- 172.21.15.87:0/1180178692 wait complete. 2024-05-09T07:54:38.503 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-09T07:54:38.503 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-09T07:54:38.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.592+0000 7f9dde66b640 1 Processor -- start 2024-05-09T07:54:38.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.592+0000 7f9dde66b640 1 -- start start 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.593+0000 7f9dde66b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80b39d0 0x7f9dd80add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.593+0000 7f9dde66b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9dd80ae2c0 0x7f9dd8147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.593+0000 7f9dde66b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd80b15a0 con 0x7f9dd8148180 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.593+0000 7f9dde66b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd80ae720 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.593+0000 7f9dde66b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd80b3db0 con 0x7f9dd80b39d0 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.593+0000 7f9dd77fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9dd80ae2c0 0x7f9dd8147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.593+0000 7f9dd7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80b39d0 0x7f9dd80add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.593+0000 7f9ddcc08640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9dd8148180 0x7f9dd8146bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:56110/0 (socket says 172.21.15.87:56110) 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.593+0000 7f9ddcc08640 1 -- 172.21.15.87:0/1150000505 learned_addr learned my addr 172.21.15.87:0/1150000505 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:38.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.594+0000 7f9dd6ffd640 1 -- 172.21.15.87:0/1150000505 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658243231 0 0) 0x7f9dd80b15a0 con 0x7f9dd8148180 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.594+0000 7f9dd6ffd640 1 -- 172.21.15.87:0/1150000505 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dc0003520 con 0x7f9dd8148180 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.594+0000 7f9dd7fff640 1 -- 172.21.15.87:0/1150000505 >> v2:172.21.15.110:3300/0 conn(0x7f9dd80ae2c0 msgr2=0x7f9dd8147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.594+0000 7f9dd7fff640 1 --2- 172.21.15.87:0/1150000505 >> v2:172.21.15.110:3300/0 conn(0x7f9dd80ae2c0 0x7f9dd8147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.594+0000 7f9dd7fff640 1 -- 172.21.15.87:0/1150000505 >> v1:172.21.15.110:6789/0 conn(0x7f9dd8148180 legacy=0x7f9dd8146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.594+0000 7f9dd7fff640 1 -- 172.21.15.87:0/1150000505 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd80af940 con 0x7f9dd80b39d0 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.594+0000 7f9dd77fe640 1 --2- 172.21.15.87:0/1150000505 >> v2:172.21.15.110:3300/0 conn(0x7f9dd80ae2c0 0x7f9dd8147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.594+0000 7f9dd7fff640 1 --2- 172.21.15.87:0/1150000505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80b39d0 0x7f9dd80add80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80097a0 tx=0x7f9dc802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ab75dc20dfcc3ba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dd6ffd640 1 -- 172.21.15.87:0/1150000505 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8037070 con 0x7f9dd80b39d0 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dd6ffd640 1 -- 172.21.15.87:0/1150000505 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc802ae50 con 0x7f9dd80b39d0 2024-05-09T07:54:38.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dd6ffd640 1 -- 172.21.15.87:0/1150000505 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8032660 con 0x7f9dd80b39d0 2024-05-09T07:54:38.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dde66b640 1 -- 172.21.15.87:0/1150000505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80b39d0 msgr2=0x7f9dd80add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:38.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dde66b640 1 --2- 172.21.15.87:0/1150000505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80b39d0 0x7f9dd80add80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80097a0 tx=0x7f9dc802a100 comp rx=0 tx=0).stop 2024-05-09T07:54:38.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dde66b640 1 -- 172.21.15.87:0/1150000505 shutdown_connections 2024-05-09T07:54:38.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dde66b640 1 --2- 172.21.15.87:0/1150000505 >> v2:172.21.15.110:3300/0 conn(0x7f9dd80ae2c0 0x7f9dd8147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:38.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dde66b640 1 --2- 172.21.15.87:0/1150000505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80b39d0 0x7f9dd80add80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:38.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dde66b640 1 -- 172.21.15.87:0/1150000505 >> 172.21.15.87:0/1150000505 conn(0x7f9dd80b5860 msgr2=0x7f9dd80b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:38.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dde66b640 1 -- 172.21.15.87:0/1150000505 shutdown_connections 2024-05-09T07:54:38.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.595+0000 7f9dde66b640 1 -- 172.21.15.87:0/1150000505 wait complete. 2024-05-09T07:54:38.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.596+0000 7f9dde66b640 1 Processor -- start 2024-05-09T07:54:38.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.596+0000 7f9dde66b640 1 -- start start 2024-05-09T07:54:38.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dde66b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dd80ae2c0 0x7f9dd81cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:38.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dde66b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd80b39d0 0x7f9dd8141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dde66b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd8148180 0x7f9dd8141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dde66b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd80b5280 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dde66b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd80b5100 con 0x7f9dd80b39d0 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dde66b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd806d830 con 0x7f9dd8148180 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dd7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dd80ae2c0 0x7f9dd81cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dd7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dd80ae2c0 0x7f9dd81cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47284/0 (socket says 172.21.15.87:47284) 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dd7fff640 1 -- 172.21.15.87:0/3899269097 learned_addr learned my addr 172.21.15.87:0/3899269097 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dd77fe640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd80b39d0 0x7f9dd8141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9ddcc08640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd8148180 0x7f9dd8141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dd7fff640 1 -- 172.21.15.87:0/3899269097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd8148180 msgr2=0x7f9dd8141b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dd7fff640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd8148180 0x7f9dd8141b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dd7fff640 1 -- 172.21.15.87:0/3899269097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd80b39d0 msgr2=0x7f9dd8141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:38.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dd7fff640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd80b39d0 0x7f9dd8141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9dd7fff640 1 -- 172.21.15.87:0/3899269097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd8142e60 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.597+0000 7f9ddcc08640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd8148180 0x7f9dd8141b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.598+0000 7f9dd7fff640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dd80ae2c0 0x7f9dd81cfc10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8035040 tx=0x7f9dc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.598+0000 7f9dd4ff9640 1 -- 172.21.15.87:0/3899269097 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8041070 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.598+0000 7f9dd4ff9640 1 -- 172.21.15.87:0/3899269097 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc803c460 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.598+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd81410d0 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.598+0000 7f9dd4ff9640 1 -- 172.21.15.87:0/3899269097 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8037040 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.598+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd8143700 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.599+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd80691f0 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.599+0000 7f9dd4ff9640 1 -- 172.21.15.87:0/3899269097 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dc803a070 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.600+0000 7f9dd4ff9640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9dc406be30 0x7f9dc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:38.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.600+0000 7f9dd4ff9640 1 -- 172.21.15.87:0/3899269097 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9dc80aaf10 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.600+0000 7f9dd77fe640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9dc406be30 0x7f9dc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:38.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.600+0000 7f9dd77fe640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9dc406be30 0x7f9dc406e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009560 tx=0x7f9dcc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:38.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.604+0000 7f9dd4ff9640 1 -- 172.21.15.87:0/3899269097 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9dd8142e60 con 0x7f9dd80ae2c0 2024-05-09T07:54:38.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:38.819+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9dd806d550 con 0x7f9dd80ae2c0 2024-05-09T07:54:39.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.478+0000 7f9dd4ff9640 1 -- 172.21.15.87:0/3899269097 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f9dc8079300 con 0x7f9dd80ae2c0 2024-05-09T07:54:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9dc406be30 msgr2=0x7f9dc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9dc406be30 0x7f9dc406e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009560 tx=0x7f9dcc009190 comp rx=0 tx=0).stop 2024-05-09T07:54:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dd80ae2c0 msgr2=0x7f9dd81cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dd80ae2c0 0x7f9dd81cfc10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8035040 tx=0x7f9dc80046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 shutdown_connections 2024-05-09T07:54:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9dc406be30 0x7f9dc406e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd8148180 0x7f9dd8141b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd80b39d0 0x7f9dd8141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 --2- 172.21.15.87:0/3899269097 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9dd80ae2c0 0x7f9dd81cfc10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 >> 172.21.15.87:0/3899269097 conn(0x7f9dd80b5860 msgr2=0x7f9dd80b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:39.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 shutdown_connections 2024-05-09T07:54:39.497 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.480+0000 7f9dde66b640 1 -- 172.21.15.87:0/3899269097 wait complete. 2024-05-09T07:54:39.506 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-09T07:54:39.506 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T07:54:39.570 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:54:39.573 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:54:39.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8d06b09640 1 Processor -- start 2024-05-09T07:54:39.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8d06b09640 1 -- start start 2024-05-09T07:54:39.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8d06b09640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8d0006b460 0x7f8d001493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8d06b09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000705d0 0x7f8d00072900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8d06b09640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d0006b840 con 0x7f8d00072e40 2024-05-09T07:54:39.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8d06b09640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f8d00148f30 con 0x7f8d0006b460 2024-05-09T07:54:39.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8d06b09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8d000718a0 con 0x7f8d000705d0 2024-05-09T07:54:39.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8cfffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000705d0 0x7f8d00072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.611 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8d050a6640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8d00072e40 0x7f8d001455b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:56116/0 (socket says 172.21.15.87:56116) 2024-05-09T07:54:39.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.595+0000 7f8d048a5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8d0006b460 0x7f8d001493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.596+0000 7f8d050a6640 1 -- 172.21.15.87:0/822920962 learned_addr learned my addr 172.21.15.87:0/822920962 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:39.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.596+0000 7f8d048a5640 1 -- 172.21.15.87:0/822920962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000705d0 msgr2=0x7f8d00072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:39.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.596+0000 7f8d048a5640 1 --2- 172.21.15.87:0/822920962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000705d0 0x7f8d00072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.596+0000 7f8d048a5640 1 -- 172.21.15.87:0/822920962 >> v1:172.21.15.110:6789/0 conn(0x7f8d00072e40 legacy=0x7f8d001455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.596+0000 7f8d048a5640 1 -- 172.21.15.87:0/822920962 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d00148bc0 con 0x7f8d0006b460 2024-05-09T07:54:39.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.596+0000 7f8cfffff640 1 --2- 172.21.15.87:0/822920962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000705d0 0x7f8d00072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:39.612 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8d048a5640 1 --2- 172.21.15.87:0/822920962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d0006b460 0x7f8d001493c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40097a0 tx=0x7f8cf402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a0a1bd2b32b6d8b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:39.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8cff7fe640 1 -- 172.21.15.87:0/822920962 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4037070 con 0x7f8d0006b460 2024-05-09T07:54:39.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8cff7fe640 1 -- 172.21.15.87:0/822920962 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf402ae50 con 0x7f8d0006b460 2024-05-09T07:54:39.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8cff7fe640 1 -- 172.21.15.87:0/822920962 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4032660 con 0x7f8d0006b460 2024-05-09T07:54:39.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8d06b09640 1 -- 172.21.15.87:0/822920962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d0006b460 msgr2=0x7f8d001493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8d06b09640 1 --2- 172.21.15.87:0/822920962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d0006b460 0x7f8d001493c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40097a0 tx=0x7f8cf402a100 comp rx=0 tx=0).stop 2024-05-09T07:54:39.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8d06b09640 1 -- 172.21.15.87:0/822920962 shutdown_connections 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8d06b09640 1 --2- 172.21.15.87:0/822920962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000705d0 0x7f8d00072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8d06b09640 1 --2- 172.21.15.87:0/822920962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d0006b460 0x7f8d001493c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8d06b09640 1 -- 172.21.15.87:0/822920962 >> 172.21.15.87:0/822920962 conn(0x7f8d000b6870 msgr2=0x7f8d000b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8d06b09640 1 -- 172.21.15.87:0/822920962 shutdown_connections 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.597+0000 7f8d06b09640 1 -- 172.21.15.87:0/822920962 wait complete. 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.598+0000 7f8d06b09640 1 Processor -- start 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.598+0000 7f8d06b09640 1 -- start start 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8d06b09640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d0006b460 0x7f8d00145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8d06b09640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d00072e40 0x7f8d000b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8d06b09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000b28f0 0x7f8d001e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8d06b09640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00149900 con 0x7f8d00072e40 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8d06b09640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00070a60 con 0x7f8d0006b460 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8d06b09640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8d00149a80 con 0x7f8d000b28f0 2024-05-09T07:54:39.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8cfffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d00072e40 0x7f8d000b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8cfffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d00072e40 0x7f8d000b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47288/0 (socket says 172.21.15.87:47288) 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8cfffff640 1 -- 172.21.15.87:0/1004528892 learned_addr learned my addr 172.21.15.87:0/1004528892 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8d048a5640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d0006b460 0x7f8d00145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.599+0000 7f8d050a6640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000b28f0 0x7f8d001e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8cfffff640 1 -- 172.21.15.87:0/1004528892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000b28f0 msgr2=0x7f8d001e5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8cfffff640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000b28f0 0x7f8d001e5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8cfffff640 1 -- 172.21.15.87:0/1004528892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d0006b460 msgr2=0x7f8d00145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8cfffff640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d0006b460 0x7f8d00145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8cfffff640 1 -- 172.21.15.87:0/1004528892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d000b1210 con 0x7f8d00072e40 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8cfffff640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d00072e40 0x7f8d000b3140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00ec10 tx=0x7f8cec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8cfd7fa640 1 -- 172.21.15.87:0/1004528892 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec017070 con 0x7f8d00072e40 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8cfd7fa640 1 -- 172.21.15.87:0/1004528892 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cec00cc30 con 0x7f8d00072e40 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d000afff0 con 0x7f8d00072e40 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8cfd7fa640 1 -- 172.21.15.87:0/1004528892 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec013470 con 0x7f8d00072e40 2024-05-09T07:54:39.617 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.600+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d000b3930 con 0x7f8d00072e40 2024-05-09T07:54:39.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.601+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d000b9990 con 0x7f8d00072e40 2024-05-09T07:54:39.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.601+0000 7f8cfd7fa640 1 -- 172.21.15.87:0/1004528892 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cec01a070 con 0x7f8d00072e40 2024-05-09T07:54:39.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.602+0000 7f8cfd7fa640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8ce406be30 0x7f8ce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.602+0000 7f8d048a5640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8ce406be30 0x7f8ce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.602+0000 7f8cfd7fa640 1 -- 172.21.15.87:0/1004528892 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8cec08acb0 con 0x7f8d00072e40 2024-05-09T07:54:39.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.602+0000 7f8d048a5640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8ce406be30 0x7f8ce406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4034000 tx=0x7f8cf402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:39.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.606+0000 7f8cfd7fa640 1 -- 172.21.15.87:0/1004528892 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8d000b9990 con 0x7f8d00072e40 2024-05-09T07:54:39.830 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.815+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d000b6200 con 0x7f8d00072e40 2024-05-09T07:54:39.831 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.816+0000 7f8cfd7fa640 1 -- 172.21.15.87:0/1004528892 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7f8d000b6200 con 0x7f8d00072e40 2024-05-09T07:54:39.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:39.831 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/138437726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":138437726},{"type":"v1","addr":"172.21.15.110:6833","nonce":138437726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T07:54:36.428491+0000","modified":"2024-05-09T07:54:38.820976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2148825985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2148825985},{"type":"v1","addr":"172.21.15.87:6835","nonce":2148825985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-05-09T07:54:39.832 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2024-05-09T07:54:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8ce406be30 msgr2=0x7f8ce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8ce406be30 0x7f8ce406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4034000 tx=0x7f8cf402e000 comp rx=0 tx=0).stop 2024-05-09T07:54:39.833 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d00072e40 msgr2=0x7f8d000b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d00072e40 0x7f8d000b3140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00ec10 tx=0x7f8cec00c520 comp rx=0 tx=0).stop 2024-05-09T07:54:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 shutdown_connections 2024-05-09T07:54:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8ce406be30 0x7f8ce406e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d000b28f0 0x7f8d001e5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d00072e40 0x7f8d000b3140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 --2- 172.21.15.87:0/1004528892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d0006b460 0x7f8d00145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.834 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 >> 172.21.15.87:0/1004528892 conn(0x7f8d000b6870 msgr2=0x7f8d00147470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 shutdown_connections 2024-05-09T07:54:39.835 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.818+0000 7f8d06b09640 1 -- 172.21.15.87:0/1004528892 wait complete. 2024-05-09T07:54:39.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:39.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.929+0000 7f0a21753640 1 Processor -- start 2024-05-09T07:54:39.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.929+0000 7f0a21753640 1 -- start start 2024-05-09T07:54:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.929+0000 7f0a21753640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0b5e60 0x7f0a1c072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a21753640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0a1c149280 0x7f0a1c1496e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a21753640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0a1c13f450 0x7f0a1c13f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a21753640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f0a1c0b2cb0 con 0x7f0a1c149280 2024-05-09T07:54:39.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a21753640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f0a1c0b31c0 con 0x7f0a1c13f450 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a21753640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c148df0 con 0x7f0a1c0b5e60 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a127fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0a1c149280 0x7f0a1c1496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a127fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0a1c149280 0x7f0a1c1496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47298/0 (socket says 172.21.15.87:47298) 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a127fc640 1 -- 172.21.15.87:0/4248533682 learned_addr learned my addr 172.21.15.87:0/4248533682 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a1b7fe640 1 --2- 172.21.15.87:0/4248533682 >> v2:172.21.15.110:3300/0 conn(0x7f0a1c13f450 0x7f0a1c13f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a1affd640 1 --2- 172.21.15.87:0/4248533682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0b5e60 0x7f0a1c072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a127fc640 1 -- 172.21.15.87:0/4248533682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0b5e60 msgr2=0x7f0a1c072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a127fc640 1 --2- 172.21.15.87:0/4248533682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0b5e60 0x7f0a1c072cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a127fc640 1 -- 172.21.15.87:0/4248533682 >> v2:172.21.15.110:3300/0 conn(0x7f0a1c13f450 msgr2=0x7f0a1c13f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a127fc640 1 --2- 172.21.15.87:0/4248533682 >> v2:172.21.15.110:3300/0 conn(0x7f0a1c13f450 0x7f0a1c13f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.930+0000 7f0a127fc640 1 -- 172.21.15.87:0/4248533682 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c0b6240 con 0x7f0a1c149280 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a127fc640 1 --2- 172.21.15.87:0/4248533682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c149280 0x7f0a1c1496e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0b4d50 tx=0x7f0a0402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5d040cabf7eca2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a1a7fc640 1 -- 172.21.15.87:0/4248533682 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04037070 con 0x7f0a1c149280 2024-05-09T07:54:39.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a1a7fc640 1 -- 172.21.15.87:0/4248533682 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a04032440 con 0x7f0a1c149280 2024-05-09T07:54:39.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a1a7fc640 1 -- 172.21.15.87:0/4248533682 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04032810 con 0x7f0a1c149280 2024-05-09T07:54:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a21753640 1 -- 172.21.15.87:0/4248533682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c149280 msgr2=0x7f0a1c1496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a21753640 1 --2- 172.21.15.87:0/4248533682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c149280 0x7f0a1c1496e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0b4d50 tx=0x7f0a0402a140 comp rx=0 tx=0).stop 2024-05-09T07:54:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a21753640 1 -- 172.21.15.87:0/4248533682 shutdown_connections 2024-05-09T07:54:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a21753640 1 --2- 172.21.15.87:0/4248533682 >> v2:172.21.15.110:3300/0 conn(0x7f0a1c13f450 0x7f0a1c13f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a21753640 1 --2- 172.21.15.87:0/4248533682 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c149280 0x7f0a1c1496e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a21753640 1 --2- 172.21.15.87:0/4248533682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0b5e60 0x7f0a1c072cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a21753640 1 -- 172.21.15.87:0/4248533682 >> 172.21.15.87:0/4248533682 conn(0x7f0a1c06c6a0 msgr2=0x7f0a1c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a21753640 1 -- 172.21.15.87:0/4248533682 shutdown_connections 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.931+0000 7f0a21753640 1 -- 172.21.15.87:0/4248533682 wait complete. 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.932+0000 7f0a21753640 1 Processor -- start 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a21753640 1 -- start start 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a21753640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0b5e60 0x7f0a1c137250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a21753640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c13f450 0x7f0a1c148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a21753640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c149280 0x7f0a1c1ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a21753640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c0b2ee0 con 0x7f0a1c13f450 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a21753640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c0b5570 con 0x7f0a1c149280 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a21753640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c09ee00 con 0x7f0a1c0b5e60 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c13f450 0x7f0a1c148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a127fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c13f450 0x7f0a1c148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47312/0 (socket says 172.21.15.87:47312) 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a127fc640 1 -- 172.21.15.87:0/2507510826 learned_addr learned my addr 172.21.15.87:0/2507510826 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:39.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a127fc640 1 -- 172.21.15.87:0/2507510826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0b5e60 msgr2=0x7f0a1c137250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a1b7fe640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c149280 0x7f0a1c1ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a127fc640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0b5e60 0x7f0a1c137250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a127fc640 1 -- 172.21.15.87:0/2507510826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c149280 msgr2=0x7f0a1c1ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a127fc640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c149280 0x7f0a1c1ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.933+0000 7f0a127fc640 1 -- 172.21.15.87:0/2507510826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c1d11f0 con 0x7f0a1c13f450 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.934+0000 7f0a127fc640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c13f450 0x7f0a1c148180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a0402a180 tx=0x7f0a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.934+0000 7f0a13fff640 1 -- 172.21.15.87:0/2507510826 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04041020 con 0x7f0a1c13f450 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.934+0000 7f0a13fff640 1 -- 172.21.15.87:0/2507510826 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a040306c0 con 0x7f0a1c13f450 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.934+0000 7f0a13fff640 1 -- 172.21.15.87:0/2507510826 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04037040 con 0x7f0a1c13f450 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.934+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1c0ade20 con 0x7f0a1c13f450 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.934+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1c137920 con 0x7f0a1c13f450 2024-05-09T07:54:39.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.935+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1c0691f0 con 0x7f0a1c13f450 2024-05-09T07:54:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.935+0000 7f0a13fff640 1 -- 172.21.15.87:0/2507510826 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a04044020 con 0x7f0a1c13f450 2024-05-09T07:54:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.936+0000 7f0a13fff640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09fc06be30 0x7f09fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.936+0000 7f0a13fff640 1 -- 172.21.15.87:0/2507510826 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0a040ab610 con 0x7f0a1c13f450 2024-05-09T07:54:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.936+0000 7f0a1affd640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09fc06be30 0x7f09fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:39.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.936+0000 7f0a1affd640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09fc06be30 0x7f09fc06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0098f0 tx=0x7f0a0c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:39.954 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:39.940+0000 7f0a13fff640 1 -- 172.21.15.87:0/2507510826 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0a0404b030 con 0x7f0a1c13f450 2024-05-09T07:54:40.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.114+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a1c0b6d50 con 0x7f0a1c13f450 2024-05-09T07:54:40.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.115+0000 7f0a13fff640 1 -- 172.21.15.87:0/2507510826 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f0a0407a050 con 0x7f0a1c13f450 2024-05-09T07:54:40.130 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:40.130 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":21,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:38.084989+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:40.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09fc06be30 msgr2=0x7f09fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09fc06be30 0x7f09fc06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0098f0 tx=0x7f0a0c008040 comp rx=0 tx=0).stop 2024-05-09T07:54:40.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c13f450 msgr2=0x7f0a1c148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c13f450 0x7f0a1c148180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a0402a180 tx=0x7f0a040046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 shutdown_connections 2024-05-09T07:54:40.132 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09fc06be30 0x7f09fc06e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c149280 0x7f0a1c1ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a1c13f450 0x7f0a1c148180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 --2- 172.21.15.87:0/2507510826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0b5e60 0x7f0a1c137250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 >> 172.21.15.87:0/2507510826 conn(0x7f0a1c06c6a0 msgr2=0x7f0a1c0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:40.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 shutdown_connections 2024-05-09T07:54:40.133 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.117+0000 7f0a21753640 1 -- 172.21.15.87:0/2507510826 wait complete. 2024-05-09T07:54:40.143 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-09T07:54:40.143 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T07:54:40.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.228+0000 7f56050ba640 1 Processor -- start 2024-05-09T07:54:40.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.228+0000 7f56050ba640 1 -- start start 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f56050ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5600067200 0x7f5600147890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f56050ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56000b55f0 0x7f5600147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f56050ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56000675e0 con 0x7f560014ae00 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f56050ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5600148310 con 0x7f56000b55f0 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f56050ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f56000b4500 con 0x7f5600067200 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55fe59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56000b55f0 0x7f5600147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55fed9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5600067200 0x7f5600147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55ff59e640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f560014ae00 0x7f560014b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:56128/0 (socket says 172.21.15.87:56128) 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55ff59e640 1 -- 172.21.15.87:0/482757989 learned_addr learned my addr 172.21.15.87:0/482757989 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55fdd9b640 1 -- 172.21.15.87:0/482757989 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652678411 0 0) 0x7f56000675e0 con 0x7f560014ae00 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55fdd9b640 1 -- 172.21.15.87:0/482757989 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55e8003520 con 0x7f560014ae00 2024-05-09T07:54:40.245 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55fe59c640 1 -- 172.21.15.87:0/482757989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5600067200 msgr2=0x7f5600147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:40.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55fe59c640 1 --2- 172.21.15.87:0/482757989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5600067200 0x7f5600147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55fe59c640 1 -- 172.21.15.87:0/482757989 >> v1:172.21.15.110:6789/0 conn(0x7f560014ae00 legacy=0x7f560014b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55fe59c640 1 -- 172.21.15.87:0/482757989 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56000aec10 con 0x7f56000b55f0 2024-05-09T07:54:40.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.229+0000 7f55fed9d640 1 --2- 172.21.15.87:0/482757989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5600067200 0x7f5600147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:40.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.230+0000 7f55fe59c640 1 --2- 172.21.15.87:0/482757989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000b55f0 0x7f5600147dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55f40097a0 tx=0x7f55f402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f593c9e11d0a4c13 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:40.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.230+0000 7f55fdd9b640 1 -- 172.21.15.87:0/482757989 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4037070 con 0x7f56000b55f0 2024-05-09T07:54:40.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.230+0000 7f55fdd9b640 1 -- 172.21.15.87:0/482757989 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f402ae50 con 0x7f56000b55f0 2024-05-09T07:54:40.246 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.230+0000 7f55fdd9b640 1 -- 172.21.15.87:0/482757989 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4032640 con 0x7f56000b55f0 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.231+0000 7f56050ba640 1 -- 172.21.15.87:0/482757989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000b55f0 msgr2=0x7f5600147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.231+0000 7f56050ba640 1 --2- 172.21.15.87:0/482757989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000b55f0 0x7f5600147dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55f40097a0 tx=0x7f55f402a100 comp rx=0 tx=0).stop 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.231+0000 7f56050ba640 1 -- 172.21.15.87:0/482757989 shutdown_connections 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.231+0000 7f56050ba640 1 --2- 172.21.15.87:0/482757989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000b55f0 0x7f5600147dd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.231+0000 7f56050ba640 1 --2- 172.21.15.87:0/482757989 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5600067200 0x7f5600147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.231+0000 7f56050ba640 1 -- 172.21.15.87:0/482757989 >> 172.21.15.87:0/482757989 conn(0x7f56000b94b0 msgr2=0x7f56000b98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.231+0000 7f56050ba640 1 -- 172.21.15.87:0/482757989 shutdown_connections 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.231+0000 7f56050ba640 1 -- 172.21.15.87:0/482757989 wait complete. 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.232+0000 7f56050ba640 1 Processor -- start 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.232+0000 7f56050ba640 1 -- start start 2024-05-09T07:54:40.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f56050ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5600067200 0x7f560009d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f56050ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560014ae00 0x7f56001e0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f56050ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000701f0 0x7f56001e04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f56050ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f56000b4190 con 0x7f5600067200 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f56050ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f56000b4c90 con 0x7f56000701f0 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f56050ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f560009bed0 con 0x7f560014ae00 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5600067200 0x7f560009d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fed9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5600067200 0x7f560009d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47324/0 (socket says 172.21.15.87:47324) 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fed9d640 1 -- 172.21.15.87:0/616197614 learned_addr learned my addr 172.21.15.87:0/616197614 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55ff59e640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000701f0 0x7f56001e04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fe59c640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560014ae00 0x7f56001e0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fed9d640 1 -- 172.21.15.87:0/616197614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560014ae00 msgr2=0x7f56001e0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fed9d640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560014ae00 0x7f56001e0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fed9d640 1 -- 172.21.15.87:0/616197614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000701f0 msgr2=0x7f56001e04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fed9d640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000701f0 0x7f56001e04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fed9d640 1 -- 172.21.15.87:0/616197614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56000706d0 con 0x7f5600067200 2024-05-09T07:54:40.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55ff59e640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000701f0 0x7f56001e04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:40.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.233+0000 7f55fed9d640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5600067200 0x7f560009d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55f000ec10 tx=0x7f55f000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:40.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.234+0000 7f55e77fe640 1 -- 172.21.15.87:0/616197614 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0017070 con 0x7f5600067200 2024-05-09T07:54:40.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.234+0000 7f55e77fe640 1 -- 172.21.15.87:0/616197614 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f000cc30 con 0x7f5600067200 2024-05-09T07:54:40.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.234+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56000709b0 con 0x7f5600067200 2024-05-09T07:54:40.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.234+0000 7f55e77fe640 1 -- 172.21.15.87:0/616197614 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0013470 con 0x7f5600067200 2024-05-09T07:54:40.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.234+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560009c7d0 con 0x7f5600067200 2024-05-09T07:54:40.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.234+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56000b5000 con 0x7f5600067200 2024-05-09T07:54:40.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.235+0000 7f55e77fe640 1 -- 172.21.15.87:0/616197614 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55f001a070 con 0x7f5600067200 2024-05-09T07:54:40.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.235+0000 7f55e77fe640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55ec06be30 0x7f55ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.235+0000 7f55fe59c640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55ec06be30 0x7f55ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.235+0000 7f55e77fe640 1 -- 172.21.15.87:0/616197614 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f55f008b0d0 con 0x7f5600067200 2024-05-09T07:54:40.252 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.236+0000 7f55fe59c640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55ec06be30 0x7f55ec06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55f4034000 tx=0x7f55f402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:40.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.240+0000 7f55e77fe640 1 -- 172.21.15.87:0/616197614 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f56000b5000 con 0x7f5600067200 2024-05-09T07:54:40.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.411+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5600146660 con 0x7f55ec06be30 2024-05-09T07:54:40.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.416+0000 7f55e77fe640 1 -- 172.21.15.87:0/616197614 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f55f407be30 con 0x7f55ec06be30 2024-05-09T07:54:40.434 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:40.435 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T07:54:40.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55ec06be30 msgr2=0x7f55ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55ec06be30 0x7f55ec06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55f4034000 tx=0x7f55f402e000 comp rx=0 tx=0).stop 2024-05-09T07:54:40.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5600067200 msgr2=0x7f560009d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5600067200 0x7f560009d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55f000ec10 tx=0x7f55f000c520 comp rx=0 tx=0).stop 2024-05-09T07:54:40.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 shutdown_connections 2024-05-09T07:54:40.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55ec06be30 0x7f55ec06e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560014ae00 0x7f56001e0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56000701f0 0x7f56001e04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 --2- 172.21.15.87:0/616197614 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5600067200 0x7f560009d390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 >> 172.21.15.87:0/616197614 conn(0x7f56000b94b0 msgr2=0x7f560014b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:40.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 shutdown_connections 2024-05-09T07:54:40.438 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.420+0000 7f56050ba640 1 -- 172.21.15.87:0/616197614 wait complete. 2024-05-09T07:54:40.445 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-09T07:54:38.891927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":236020,"kb_used_data":2440,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738700,"statfs":{"total":773094113280,"available":772852428800,"internally_reserved":0,"allocated":2498560,"data_stored":1579760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000918"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T07:54:27.838630+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:54:27.838630+0000","last_peered":"2024-05-09T07:54:27.838630+0000","last_clean":"2024-05-09T07:54:27.838630+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:54:27.838630+0000","last_undegraded":"2024-05-09T07:54:27.838630+0000","last_fullsized":"2024-05-09T07:54:27.838630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28380,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343460,"statfs":{"total":96636764160,"available":96607703040,"internally_reserved":0,"allocated":757760,"data_stored":640246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":757760,"data_stored":640246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31348,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T07:54:40.451 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T07:54:40.475 INFO:tasks.ceph.mds.a.smithi087.stderr:2024-05-09T07:54:40.461+0000 7f50f4b3b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.561+0000 7f23e24a5640 1 Processor -- start 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.561+0000 7f23e24a5640 1 -- start start 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.561+0000 7f23e24a5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc0b5e20 0x7f23dc147720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.561+0000 7f23e24a5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23dc0b3e30 0x7f23dc141580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.561+0000 7f23e24a5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23dc0b5900 con 0x7f23dc141ac0 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.561+0000 7f23e24a5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f23dc0b50c0 con 0x7f23dc0b3e30 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.561+0000 7f23e24a5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc0b4a70 con 0x7f23dc0b5e20 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.561+0000 7f23d3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23dc0b3e30 0x7f23dc141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.561+0000 7f23d3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f23dc0b3e30 0x7f23dc141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47330/0 (socket says 172.21.15.87:47330) 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.562+0000 7f23d3fff640 1 -- 172.21.15.87:0/700027184 learned_addr learned my addr 172.21.15.87:0/700027184 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:40.577 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.562+0000 7f23dbfff640 1 --2- 172.21.15.87:0/700027184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc0b5e20 0x7f23dc147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.562+0000 7f23d3fff640 1 -- 172.21.15.87:0/700027184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc0b5e20 msgr2=0x7f23dc147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:40.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.562+0000 7f23d3fff640 1 --2- 172.21.15.87:0/700027184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc0b5e20 0x7f23dc147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.562+0000 7f23d3fff640 1 -- 172.21.15.87:0/700027184 >> v1:172.21.15.110:6789/0 conn(0x7f23dc141ac0 legacy=0x7f23dc0b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.578 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.562+0000 7f23d3fff640 1 -- 172.21.15.87:0/700027184 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc0b4d50 con 0x7f23dc0b3e30 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.562+0000 7f23d3fff640 1 --2- 172.21.15.87:0/700027184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b3e30 0x7f23dc141580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009870 tx=0x7f23c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c60fb88d4c23c8d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23db7fe640 1 -- 172.21.15.87:0/700027184 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4037070 con 0x7f23dc0b3e30 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23db7fe640 1 -- 172.21.15.87:0/700027184 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c4032440 con 0x7f23dc0b3e30 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23db7fe640 1 -- 172.21.15.87:0/700027184 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4032810 con 0x7f23dc0b3e30 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23e24a5640 1 -- 172.21.15.87:0/700027184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b3e30 msgr2=0x7f23dc141580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23e24a5640 1 --2- 172.21.15.87:0/700027184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b3e30 0x7f23dc141580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009870 tx=0x7f23c402a270 comp rx=0 tx=0).stop 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23e24a5640 1 -- 172.21.15.87:0/700027184 shutdown_connections 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23e24a5640 1 --2- 172.21.15.87:0/700027184 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b3e30 0x7f23dc141580 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23e24a5640 1 --2- 172.21.15.87:0/700027184 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc0b5e20 0x7f23dc147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23e24a5640 1 -- 172.21.15.87:0/700027184 >> 172.21.15.87:0/700027184 conn(0x7f23dc0676a0 msgr2=0x7f23dc0bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23e24a5640 1 -- 172.21.15.87:0/700027184 shutdown_connections 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.563+0000 7f23e24a5640 1 -- 172.21.15.87:0/700027184 wait complete. 2024-05-09T07:54:40.581 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.564+0000 7f23e24a5640 1 Processor -- start 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.564+0000 7f23e24a5640 1 -- start start 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23e24a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23dc0b3e30 0x7f23dc1d3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23e24a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b5e20 0x7f23dc13ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23e24a5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc141ac0 0x7f23dc139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23e24a5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc0b5550 con 0x7f23dc0b5e20 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23e24a5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f23dc0bdbc0 con 0x7f23dc0b3e30 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23e24a5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f23dc1d0b10 con 0x7f23dc141ac0 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b5e20 0x7f23dc13ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b5e20 0x7f23dc13ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47340/0 (socket says 172.21.15.87:47340) 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d3fff640 1 -- 172.21.15.87:0/2162787018 learned_addr learned my addr 172.21.15.87:0/2162787018 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23dbfff640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23dc0b3e30 0x7f23dc1d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23e0a42640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc141ac0 0x7f23dc139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d3fff640 1 -- 172.21.15.87:0/2162787018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc141ac0 msgr2=0x7f23dc139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d3fff640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc141ac0 0x7f23dc139fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.582 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d3fff640 1 -- 172.21.15.87:0/2162787018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23dc0b3e30 msgr2=0x7f23dc1d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d3fff640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23dc0b3e30 0x7f23dc1d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d3fff640 1 -- 172.21.15.87:0/2162787018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23dc141530 con 0x7f23dc0b5e20 2024-05-09T07:54:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23e0a42640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc141ac0 0x7f23dc139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d3fff640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b5e20 0x7f23dc13ae80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009870 tx=0x7f23c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.565+0000 7f23d97fa640 1 -- 172.21.15.87:0/2162787018 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4041070 con 0x7f23dc0b5e20 2024-05-09T07:54:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.566+0000 7f23d97fa640 1 -- 172.21.15.87:0/2162787018 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c403c870 con 0x7f23dc0b5e20 2024-05-09T07:54:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.566+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23dc1397a0 con 0x7f23dc0b5e20 2024-05-09T07:54:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.566+0000 7f23d97fa640 1 -- 172.21.15.87:0/2162787018 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4037040 con 0x7f23dc0b5e20 2024-05-09T07:54:40.583 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.566+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23dc0b3690 con 0x7f23dc0b5e20 2024-05-09T07:54:40.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.567+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23dc1d26e0 con 0x7f23dc0b5e20 2024-05-09T07:54:40.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.567+0000 7f23d97fa640 1 -- 172.21.15.87:0/2162787018 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23c4044070 con 0x7f23dc0b5e20 2024-05-09T07:54:40.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.568+0000 7f23d97fa640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f23bc06be30 0x7f23bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.568+0000 7f23dbfff640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f23bc06be30 0x7f23bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.568+0000 7f23d97fa640 1 -- 172.21.15.87:0/2162787018 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f23c40ab940 con 0x7f23dc0b5e20 2024-05-09T07:54:40.584 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.568+0000 7f23dbfff640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f23bc06be30 0x7f23bc06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00b9b0 tx=0x7f23cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:40.586 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.572+0000 7f23d97fa640 1 -- 172.21.15.87:0/2162787018 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f23dc1d26e0 con 0x7f23dc0b5e20 2024-05-09T07:54:40.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.741+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23dc0691f0 con 0x7f23bc06be30 2024-05-09T07:54:40.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.746+0000 7f23d97fa640 1 -- 172.21.15.87:0/2162787018 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f23dc0691f0 con 0x7f23bc06be30 2024-05-09T07:54:40.763 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:40.764 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f23bc06be30 msgr2=0x7f23bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f23bc06be30 0x7f23bc06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00b9b0 tx=0x7f23cc008040 comp rx=0 tx=0).stop 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b5e20 msgr2=0x7f23dc13ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b5e20 0x7f23dc13ae80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009870 tx=0x7f23c40046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 shutdown_connections 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f23bc06be30 0x7f23bc06e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23dc141ac0 0x7f23dc139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f23dc0b5e20 0x7f23dc13ae80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 --2- 172.21.15.87:0/2162787018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23dc0b3e30 0x7f23dc1d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 >> 172.21.15.87:0/2162787018 conn(0x7f23dc0676a0 msgr2=0x7f23dc0b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:40.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 shutdown_connections 2024-05-09T07:54:40.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.749+0000 7f23e24a5640 1 -- 172.21.15.87:0/2162787018 wait complete. 2024-05-09T07:54:40.775 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-09T07:54:38.891927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":236020,"kb_used_data":2440,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738700,"statfs":{"total":773094113280,"available":772852428800,"internally_reserved":0,"allocated":2498560,"data_stored":1579760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000918"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-09T07:54:27.838630+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:54:27.838630+0000","last_peered":"2024-05-09T07:54:27.838630+0000","last_clean":"2024-05-09T07:54:27.838630+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:54:27.838630+0000","last_undegraded":"2024-05-09T07:54:27.838630+0000","last_fullsized":"2024-05-09T07:54:27.838630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:36.079119+0000","last_change":"2024-05-09T07:54:36.079119+0000","last_active":"2024-05-09T07:54:36.079119+0000","last_peered":"2024-05-09T07:54:36.079119+0000","last_clean":"2024-05-09T07:54:36.079119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:36.079119+0000","last_undegraded":"2024-05-09T07:54:36.079119+0000","last_fullsized":"2024-05-09T07:54:36.079119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-09T07:54:35.075148+0000","last_change":"2024-05-09T07:54:35.075148+0000","last_active":"2024-05-09T07:54:35.075148+0000","last_peered":"2024-05-09T07:54:35.075148+0000","last_clean":"2024-05-09T07:54:35.075148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-09T07:54:35.075148+0000","last_undegraded":"2024-05-09T07:54:35.075148+0000","last_fullsized":"2024-05-09T07:54:35.075148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28380,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343460,"statfs":{"total":96636764160,"available":96607703040,"internally_reserved":0,"allocated":757760,"data_stored":640246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":757760,"data_stored":640246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31348,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":163840,"data_stored":49878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T07:54:40.778 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T07:54:40.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.901+0000 7fd02a13b640 1 Processor -- start 2024-05-09T07:54:40.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.901+0000 7fd02a13b640 1 -- start start 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd02a13b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd02406dcb0 0x7fd02406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd02a13b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd024147820 0x7fd02406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd02a13b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024072850 0x7fd024147f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd02a13b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fd02406c300 con 0x7fd02406dcb0 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd02a13b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fd0240723c0 con 0x7fd024147820 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd02a13b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd024072e00 con 0x7fd024072850 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd0237fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd02406dcb0 0x7fd02406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd0237fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd02406dcb0 0x7fd02406d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47352/0 (socket says 172.21.15.87:47352) 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd0237fe640 1 -- 172.21.15.87:0/4294860417 learned_addr learned my addr 172.21.15.87:0/4294860417 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd023fff640 1 --2- 172.21.15.87:0/4294860417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024072850 0x7fd024147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd022ffd640 1 --2- 172.21.15.87:0/4294860417 >> v2:172.21.15.110:3300/0 conn(0x7fd024147820 0x7fd02406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd0237fe640 1 -- 172.21.15.87:0/4294860417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024072850 msgr2=0x7fd024147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd0237fe640 1 --2- 172.21.15.87:0/4294860417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024072850 0x7fd024147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd0237fe640 1 -- 172.21.15.87:0/4294860417 >> v2:172.21.15.110:3300/0 conn(0x7fd024147820 msgr2=0x7fd02406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd0237fe640 1 --2- 172.21.15.87:0/4294860417 >> v2:172.21.15.110:3300/0 conn(0x7fd024147820 0x7fd02406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd0237fe640 1 -- 172.21.15.87:0/4294860417 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0240730e0 con 0x7fd02406dcb0 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.902+0000 7fd023fff640 1 --2- 172.21.15.87:0/4294860417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024072850 0x7fd024147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.903+0000 7fd0237fe640 1 --2- 172.21.15.87:0/4294860417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02406dcb0 0x7fd02406d4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0240719d0 tx=0x7fd01402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afaf80371759f64c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.903+0000 7fd0227fc640 1 -- 172.21.15.87:0/4294860417 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014036070 con 0x7fd02406dcb0 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.903+0000 7fd0227fc640 1 -- 172.21.15.87:0/4294860417 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd014031600 con 0x7fd02406dcb0 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.903+0000 7fd0227fc640 1 -- 172.21.15.87:0/4294860417 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0140319d0 con 0x7fd02406dcb0 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.904+0000 7fd02a13b640 1 -- 172.21.15.87:0/4294860417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02406dcb0 msgr2=0x7fd02406d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.904+0000 7fd02a13b640 1 --2- 172.21.15.87:0/4294860417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02406dcb0 0x7fd02406d4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd0240719d0 tx=0x7fd01402a610 comp rx=0 tx=0).stop 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.904+0000 7fd02a13b640 1 -- 172.21.15.87:0/4294860417 shutdown_connections 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.904+0000 7fd02a13b640 1 --2- 172.21.15.87:0/4294860417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024072850 0x7fd024147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.904+0000 7fd02a13b640 1 --2- 172.21.15.87:0/4294860417 >> v2:172.21.15.110:3300/0 conn(0x7fd024147820 0x7fd02406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.904+0000 7fd02a13b640 1 --2- 172.21.15.87:0/4294860417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd02406dcb0 0x7fd02406d4a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.904+0000 7fd02a13b640 1 -- 172.21.15.87:0/4294860417 >> 172.21.15.87:0/4294860417 conn(0x7fd0240bae60 msgr2=0x7fd0240bb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.904+0000 7fd02a13b640 1 -- 172.21.15.87:0/4294860417 shutdown_connections 2024-05-09T07:54:40.921 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.904+0000 7fd02a13b640 1 -- 172.21.15.87:0/4294860417 wait complete. 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.905+0000 7fd02a13b640 1 Processor -- start 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.905+0000 7fd02a13b640 1 -- start start 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.905+0000 7fd02a13b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd02406dcb0 0x7fd0241dda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.905+0000 7fd02a13b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd024072850 0x7fd02409ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd02a13b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024147820 0x7fd024142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd02a13b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd0241484a0 con 0x7fd024072850 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd02a13b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd02406ccd0 con 0x7fd02406dcb0 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd02a13b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd024148620 con 0x7fd024147820 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd022ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd024072850 0x7fd02409ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd022ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd024072850 0x7fd02409ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47362/0 (socket says 172.21.15.87:47362) 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd022ffd640 1 -- 172.21.15.87:0/2319915016 learned_addr learned my addr 172.21.15.87:0/2319915016 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd0237fe640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd02406dcb0 0x7fd0241dda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd023fff640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024147820 0x7fd024142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd022ffd640 1 -- 172.21.15.87:0/2319915016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024147820 msgr2=0x7fd024142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd022ffd640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024147820 0x7fd024142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd022ffd640 1 -- 172.21.15.87:0/2319915016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd02406dcb0 msgr2=0x7fd0241dda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd022ffd640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd02406dcb0 0x7fd0241dda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd022ffd640 1 -- 172.21.15.87:0/2319915016 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0241dd220 con 0x7fd024072850 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd0237fe640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd02406dcb0 0x7fd0241dda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd022ffd640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd024072850 0x7fd02409ee50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd01800e9b0 tx=0x7fd01800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:40.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd00bfff640 1 -- 172.21.15.87:0/2319915016 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018017070 con 0x7fd024072850 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd00bfff640 1 -- 172.21.15.87:0/2319915016 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd01800c9a0 con 0x7fd024072850 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0240a0bd0 con 0x7fd024072850 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd00bfff640 1 -- 172.21.15.87:0/2319915016 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01800cd90 con 0x7fd024072850 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.906+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0241dced0 con 0x7fd024072850 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.907+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0240691f0 con 0x7fd024072850 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.908+0000 7fd00bfff640 1 -- 172.21.15.87:0/2319915016 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd01801a070 con 0x7fd024072850 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.908+0000 7fd00bfff640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd01006be30 0x7fd01006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.908+0000 7fd0237fe640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd01006be30 0x7fd01006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.908+0000 7fd00bfff640 1 -- 172.21.15.87:0/2319915016 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd01808ada0 con 0x7fd024072850 2024-05-09T07:54:40.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.909+0000 7fd0237fe640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd01006be30 0x7fd01006e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd014033000 tx=0x7fd014009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:40.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:40.912+0000 7fd00bfff640 1 -- 172.21.15.87:0/2319915016 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd0180597e0 con 0x7fd024072850 2024-05-09T07:54:41.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.087+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd02406c9d0 con 0x7fd01006be30 2024-05-09T07:54:41.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.093+0000 7fd00bfff640 1 -- 172.21.15.87:0/2319915016 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7fd02406c9d0 con 0x7fd01006be30 2024-05-09T07:54:41.111 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:41.112 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T07:54:41.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd01006be30 msgr2=0x7fd01006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd01006be30 0x7fd01006e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd014033000 tx=0x7fd014009000 comp rx=0 tx=0).stop 2024-05-09T07:54:41.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd024072850 msgr2=0x7fd02409ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd024072850 0x7fd02409ee50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd01800e9b0 tx=0x7fd01800ee70 comp rx=0 tx=0).stop 2024-05-09T07:54:41.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 shutdown_connections 2024-05-09T07:54:41.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd01006be30 0x7fd01006e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd024147820 0x7fd024142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd024072850 0x7fd02409ee50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 --2- 172.21.15.87:0/2319915016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd02406dcb0 0x7fd0241dda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 >> 172.21.15.87:0/2319915016 conn(0x7fd0240bae60 msgr2=0x7fd0240b66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:41.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 shutdown_connections 2024-05-09T07:54:41.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.096+0000 7fd02a13b640 1 -- 172.21.15.87:0/2319915016 wait complete. 2024-05-09T07:54:41.121 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-09T07:54:40.892345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235688,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739032,"statfs":{"total":773094113280,"available":772852768768,"internally_reserved":0,"allocated":2932736,"data_stored":1773316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.813171"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126816+0000","last_change":"2024-05-09T07:54:37.107065+0000","last_active":"2024-05-09T07:54:38.126816+0000","last_peered":"2024-05-09T07:54:38.126816+0000","last_clean":"2024-05-09T07:54:38.126816+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T07:54:38.126816+0000","last_undegraded":"2024-05-09T07:54:38.126816+0000","last_fullsized":"2024-05-09T07:54:38.126816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089122+0000","last_change":"2024-05-09T07:54:37.109460+0000","last_active":"2024-05-09T07:54:38.089122+0000","last_peered":"2024-05-09T07:54:38.089122+0000","last_clean":"2024-05-09T07:54:38.089122+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T07:54:38.089122+0000","last_undegraded":"2024-05-09T07:54:38.089122+0000","last_fullsized":"2024-05-09T07:54:38.089122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114255+0000","last_change":"2024-05-09T07:54:37.108923+0000","last_active":"2024-05-09T07:54:38.114255+0000","last_peered":"2024-05-09T07:54:38.114255+0000","last_clean":"2024-05-09T07:54:38.114255+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T07:54:38.114255+0000","last_undegraded":"2024-05-09T07:54:38.114255+0000","last_fullsized":"2024-05-09T07:54:38.114255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090307+0000","last_change":"2024-05-09T07:54:37.104600+0000","last_active":"2024-05-09T07:54:38.090307+0000","last_peered":"2024-05-09T07:54:38.090307+0000","last_clean":"2024-05-09T07:54:38.090307+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T07:54:38.090307+0000","last_undegraded":"2024-05-09T07:54:38.090307+0000","last_fullsized":"2024-05-09T07:54:38.090307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126911+0000","last_change":"2024-05-09T07:54:37.104101+0000","last_active":"2024-05-09T07:54:38.126911+0000","last_peered":"2024-05-09T07:54:38.126911+0000","last_clean":"2024-05-09T07:54:38.126911+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T07:54:38.126911+0000","last_undegraded":"2024-05-09T07:54:38.126911+0000","last_fullsized":"2024-05-09T07:54:38.126911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089353+0000","last_change":"2024-05-09T07:54:37.109462+0000","last_active":"2024-05-09T07:54:38.089353+0000","last_peered":"2024-05-09T07:54:38.089353+0000","last_clean":"2024-05-09T07:54:38.089353+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T07:54:38.089353+0000","last_undegraded":"2024-05-09T07:54:38.089353+0000","last_fullsized":"2024-05-09T07:54:38.089353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126521+0000","last_change":"2024-05-09T07:54:37.114222+0000","last_active":"2024-05-09T07:54:38.126521+0000","last_peered":"2024-05-09T07:54:38.126521+0000","last_clean":"2024-05-09T07:54:38.126521+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T07:54:38.126521+0000","last_undegraded":"2024-05-09T07:54:38.126521+0000","last_fullsized":"2024-05-09T07:54:38.126521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125744+0000","last_change":"2024-05-09T07:54:37.110852+0000","last_active":"2024-05-09T07:54:38.125744+0000","last_peered":"2024-05-09T07:54:38.125744+0000","last_clean":"2024-05-09T07:54:38.125744+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T07:54:38.125744+0000","last_undegraded":"2024-05-09T07:54:38.125744+0000","last_fullsized":"2024-05-09T07:54:38.125744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126973+0000","last_change":"2024-05-09T07:54:37.106997+0000","last_active":"2024-05-09T07:54:38.126973+0000","last_peered":"2024-05-09T07:54:38.126973+0000","last_clean":"2024-05-09T07:54:38.126973+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T07:54:38.126973+0000","last_undegraded":"2024-05-09T07:54:38.126973+0000","last_fullsized":"2024-05-09T07:54:38.126973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090143+0000","last_change":"2024-05-09T07:54:37.112111+0000","last_active":"2024-05-09T07:54:38.090143+0000","last_peered":"2024-05-09T07:54:38.090143+0000","last_clean":"2024-05-09T07:54:38.090143+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T07:54:38.090143+0000","last_undegraded":"2024-05-09T07:54:38.090143+0000","last_fullsized":"2024-05-09T07:54:38.090143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089595+0000","last_change":"2024-05-09T07:54:37.111412+0000","last_active":"2024-05-09T07:54:38.089595+0000","last_peered":"2024-05-09T07:54:38.089595+0000","last_clean":"2024-05-09T07:54:38.089595+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T07:54:38.089595+0000","last_undegraded":"2024-05-09T07:54:38.089595+0000","last_fullsized":"2024-05-09T07:54:38.089595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126529+0000","last_change":"2024-05-09T07:54:37.103229+0000","last_active":"2024-05-09T07:54:38.126529+0000","last_peered":"2024-05-09T07:54:38.126529+0000","last_clean":"2024-05-09T07:54:38.126529+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T07:54:38.126529+0000","last_undegraded":"2024-05-09T07:54:38.126529+0000","last_fullsized":"2024-05-09T07:54:38.126529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125825+0000","last_change":"2024-05-09T07:54:37.104238+0000","last_active":"2024-05-09T07:54:38.125825+0000","last_peered":"2024-05-09T07:54:38.125825+0000","last_clean":"2024-05-09T07:54:38.125825+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T07:54:38.125825+0000","last_undegraded":"2024-05-09T07:54:38.125825+0000","last_fullsized":"2024-05-09T07:54:38.125825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114110+0000","last_change":"2024-05-09T07:54:37.105958+0000","last_active":"2024-05-09T07:54:38.114110+0000","last_peered":"2024-05-09T07:54:38.114110+0000","last_clean":"2024-05-09T07:54:38.114110+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T07:54:38.114110+0000","last_undegraded":"2024-05-09T07:54:38.114110+0000","last_fullsized":"2024-05-09T07:54:38.114110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:38.316625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089163+0000","last_change":"2024-05-09T07:54:37.090690+0000","last_active":"2024-05-09T07:54:38.089163+0000","last_peered":"2024-05-09T07:54:38.089163+0000","last_clean":"2024-05-09T07:54:38.089163+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T07:54:38.089163+0000","last_undegraded":"2024-05-09T07:54:38.089163+0000","last_fullsized":"2024-05-09T07:54:38.089163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088954+0000","last_change":"2024-05-09T07:54:37.110834+0000","last_active":"2024-05-09T07:54:38.088954+0000","last_peered":"2024-05-09T07:54:38.088954+0000","last_clean":"2024-05-09T07:54:38.088954+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T07:54:38.088954+0000","last_undegraded":"2024-05-09T07:54:38.088954+0000","last_fullsized":"2024-05-09T07:54:38.088954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090130+0000","last_change":"2024-05-09T07:54:37.099545+0000","last_active":"2024-05-09T07:54:38.090130+0000","last_peered":"2024-05-09T07:54:38.090130+0000","last_clean":"2024-05-09T07:54:38.090130+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T07:54:38.090130+0000","last_undegraded":"2024-05-09T07:54:38.090130+0000","last_fullsized":"2024-05-09T07:54:38.090130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:37.105054+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127307+0000","last_change":"2024-05-09T07:54:37.104090+0000","last_active":"2024-05-09T07:54:38.127307+0000","last_peered":"2024-05-09T07:54:38.127307+0000","last_clean":"2024-05-09T07:54:38.127307+0000","last_became_active":"2024-05-09T07:54:37.103793+0000","last_became_peered":"2024-05-09T07:54:37.103793+0000","last_unstale":"2024-05-09T07:54:38.127307+0000","last_undegraded":"2024-05-09T07:54:38.127307+0000","last_fullsized":"2024-05-09T07:54:38.127307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089303+0000","last_change":"2024-05-09T07:54:37.110846+0000","last_active":"2024-05-09T07:54:38.089303+0000","last_peered":"2024-05-09T07:54:38.089303+0000","last_clean":"2024-05-09T07:54:38.089303+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T07:54:38.089303+0000","last_undegraded":"2024-05-09T07:54:38.089303+0000","last_fullsized":"2024-05-09T07:54:38.089303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114306+0000","last_change":"2024-05-09T07:54:37.110392+0000","last_active":"2024-05-09T07:54:38.114306+0000","last_peered":"2024-05-09T07:54:38.114306+0000","last_clean":"2024-05-09T07:54:38.114306+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T07:54:38.114306+0000","last_undegraded":"2024-05-09T07:54:38.114306+0000","last_fullsized":"2024-05-09T07:54:38.114306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090055+0000","last_change":"2024-05-09T07:54:37.098797+0000","last_active":"2024-05-09T07:54:38.090055+0000","last_peered":"2024-05-09T07:54:38.090055+0000","last_clean":"2024-05-09T07:54:38.090055+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T07:54:38.090055+0000","last_undegraded":"2024-05-09T07:54:38.090055+0000","last_fullsized":"2024-05-09T07:54:38.090055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125904+0000","last_change":"2024-05-09T07:54:37.112262+0000","last_active":"2024-05-09T07:54:38.125904+0000","last_peered":"2024-05-09T07:54:38.125904+0000","last_clean":"2024-05-09T07:54:38.125904+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T07:54:38.125904+0000","last_undegraded":"2024-05-09T07:54:38.125904+0000","last_fullsized":"2024-05-09T07:54:38.125904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090032+0000","last_change":"2024-05-09T07:54:37.102723+0000","last_active":"2024-05-09T07:54:38.090032+0000","last_peered":"2024-05-09T07:54:38.090032+0000","last_clean":"2024-05-09T07:54:38.090032+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T07:54:38.090032+0000","last_undegraded":"2024-05-09T07:54:38.090032+0000","last_fullsized":"2024-05-09T07:54:38.090032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126375+0000","last_change":"2024-05-09T07:54:37.101021+0000","last_active":"2024-05-09T07:54:38.126375+0000","last_peered":"2024-05-09T07:54:38.126375+0000","last_clean":"2024-05-09T07:54:38.126375+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T07:54:38.126375+0000","last_undegraded":"2024-05-09T07:54:38.126375+0000","last_fullsized":"2024-05-09T07:54:38.126375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090192+0000","last_change":"2024-05-09T07:54:37.106515+0000","last_active":"2024-05-09T07:54:38.090192+0000","last_peered":"2024-05-09T07:54:38.090192+0000","last_clean":"2024-05-09T07:54:38.090192+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T07:54:38.090192+0000","last_undegraded":"2024-05-09T07:54:38.090192+0000","last_fullsized":"2024-05-09T07:54:38.090192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089051+0000","last_change":"2024-05-09T07:54:37.101475+0000","last_active":"2024-05-09T07:54:38.089051+0000","last_peered":"2024-05-09T07:54:38.089051+0000","last_clean":"2024-05-09T07:54:38.089051+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T07:54:38.089051+0000","last_undegraded":"2024-05-09T07:54:38.089051+0000","last_fullsized":"2024-05-09T07:54:38.089051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126288+0000","last_change":"2024-05-09T07:54:37.112908+0000","last_active":"2024-05-09T07:54:38.126288+0000","last_peered":"2024-05-09T07:54:38.126288+0000","last_clean":"2024-05-09T07:54:38.126288+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T07:54:38.126288+0000","last_undegraded":"2024-05-09T07:54:38.126288+0000","last_fullsized":"2024-05-09T07:54:38.126288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114353+0000","last_change":"2024-05-09T07:54:37.109141+0000","last_active":"2024-05-09T07:54:38.114353+0000","last_peered":"2024-05-09T07:54:38.114353+0000","last_clean":"2024-05-09T07:54:38.114353+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T07:54:38.114353+0000","last_undegraded":"2024-05-09T07:54:38.114353+0000","last_fullsized":"2024-05-09T07:54:38.114353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089775+0000","last_change":"2024-05-09T07:54:37.103105+0000","last_active":"2024-05-09T07:54:38.089775+0000","last_peered":"2024-05-09T07:54:38.089775+0000","last_clean":"2024-05-09T07:54:38.089775+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T07:54:38.089775+0000","last_undegraded":"2024-05-09T07:54:38.089775+0000","last_fullsized":"2024-05-09T07:54:38.089775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125972+0000","last_change":"2024-05-09T07:54:37.109657+0000","last_active":"2024-05-09T07:54:38.125972+0000","last_peered":"2024-05-09T07:54:38.125972+0000","last_clean":"2024-05-09T07:54:38.125972+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T07:54:38.125972+0000","last_undegraded":"2024-05-09T07:54:38.125972+0000","last_fullsized":"2024-05-09T07:54:38.125972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089035+0000","last_change":"2024-05-09T07:54:37.111278+0000","last_active":"2024-05-09T07:54:38.089035+0000","last_peered":"2024-05-09T07:54:38.089035+0000","last_clean":"2024-05-09T07:54:38.089035+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T07:54:38.089035+0000","last_undegraded":"2024-05-09T07:54:38.089035+0000","last_fullsized":"2024-05-09T07:54:38.089035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126302+0000","last_change":"2024-05-09T07:54:37.099560+0000","last_active":"2024-05-09T07:54:38.126302+0000","last_peered":"2024-05-09T07:54:38.126302+0000","last_clean":"2024-05-09T07:54:38.126302+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T07:54:38.126302+0000","last_undegraded":"2024-05-09T07:54:38.126302+0000","last_fullsized":"2024-05-09T07:54:38.126302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:30.636185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126183+0000","last_change":"2024-05-09T07:54:36.105511+0000","last_active":"2024-05-09T07:54:38.126183+0000","last_peered":"2024-05-09T07:54:38.126183+0000","last_clean":"2024-05-09T07:54:38.126183+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T07:54:38.126183+0000","last_undegraded":"2024-05-09T07:54:38.126183+0000","last_fullsized":"2024-05-09T07:54:38.126183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114445+0000","last_change":"2024-05-09T07:54:37.110626+0000","last_active":"2024-05-09T07:54:38.114445+0000","last_peered":"2024-05-09T07:54:38.114445+0000","last_clean":"2024-05-09T07:54:38.114445+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T07:54:38.114445+0000","last_undegraded":"2024-05-09T07:54:38.114445+0000","last_fullsized":"2024-05-09T07:54:38.114445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089405+0000","last_change":"2024-05-09T07:54:36.099522+0000","last_active":"2024-05-09T07:54:38.089405+0000","last_peered":"2024-05-09T07:54:38.089405+0000","last_clean":"2024-05-09T07:54:38.089405+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T07:54:38.089405+0000","last_undegraded":"2024-05-09T07:54:38.089405+0000","last_fullsized":"2024-05-09T07:54:38.089405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126052+0000","last_change":"2024-05-09T07:54:36.103352+0000","last_active":"2024-05-09T07:54:38.126052+0000","last_peered":"2024-05-09T07:54:38.126052+0000","last_clean":"2024-05-09T07:54:38.126052+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T07:54:38.126052+0000","last_undegraded":"2024-05-09T07:54:38.126052+0000","last_fullsized":"2024-05-09T07:54:38.126052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125742+0000","last_change":"2024-05-09T07:54:37.113565+0000","last_active":"2024-05-09T07:54:38.125742+0000","last_peered":"2024-05-09T07:54:38.125742+0000","last_clean":"2024-05-09T07:54:38.125742+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T07:54:38.125742+0000","last_undegraded":"2024-05-09T07:54:38.125742+0000","last_fullsized":"2024-05-09T07:54:38.125742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089786+0000","last_change":"2024-05-09T07:54:36.091893+0000","last_active":"2024-05-09T07:54:38.089786+0000","last_peered":"2024-05-09T07:54:38.089786+0000","last_clean":"2024-05-09T07:54:38.089786+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T07:54:38.089786+0000","last_undegraded":"2024-05-09T07:54:38.089786+0000","last_fullsized":"2024-05-09T07:54:38.089786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088976+0000","last_change":"2024-05-09T07:54:37.106284+0000","last_active":"2024-05-09T07:54:38.088976+0000","last_peered":"2024-05-09T07:54:38.088976+0000","last_clean":"2024-05-09T07:54:38.088976+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T07:54:38.088976+0000","last_undegraded":"2024-05-09T07:54:38.088976+0000","last_fullsized":"2024-05-09T07:54:38.088976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089802+0000","last_change":"2024-05-09T07:54:36.100068+0000","last_active":"2024-05-09T07:54:38.089802+0000","last_peered":"2024-05-09T07:54:38.089802+0000","last_clean":"2024-05-09T07:54:38.089802+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T07:54:38.089802+0000","last_undegraded":"2024-05-09T07:54:38.089802+0000","last_fullsized":"2024-05-09T07:54:38.089802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089637+0000","last_change":"2024-05-09T07:54:37.099653+0000","last_active":"2024-05-09T07:54:38.089637+0000","last_peered":"2024-05-09T07:54:38.089637+0000","last_clean":"2024-05-09T07:54:38.089637+0000","last_became_active":"2024-05-09T07:54:37.099256+0000","last_became_peered":"2024-05-09T07:54:37.099256+0000","last_unstale":"2024-05-09T07:54:38.089637+0000","last_undegraded":"2024-05-09T07:54:38.089637+0000","last_fullsized":"2024-05-09T07:54:38.089637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090072+0000","last_change":"2024-05-09T07:54:36.100368+0000","last_active":"2024-05-09T07:54:38.090072+0000","last_peered":"2024-05-09T07:54:38.090072+0000","last_clean":"2024-05-09T07:54:38.090072+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T07:54:38.090072+0000","last_undegraded":"2024-05-09T07:54:38.090072+0000","last_fullsized":"2024-05-09T07:54:38.090072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114311+0000","last_change":"2024-05-09T07:54:37.107847+0000","last_active":"2024-05-09T07:54:38.114311+0000","last_peered":"2024-05-09T07:54:38.114311+0000","last_clean":"2024-05-09T07:54:38.114311+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T07:54:38.114311+0000","last_undegraded":"2024-05-09T07:54:38.114311+0000","last_fullsized":"2024-05-09T07:54:38.114311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089184+0000","last_change":"2024-05-09T07:54:36.101694+0000","last_active":"2024-05-09T07:54:38.089184+0000","last_peered":"2024-05-09T07:54:38.089184+0000","last_clean":"2024-05-09T07:54:38.089184+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T07:54:38.089184+0000","last_undegraded":"2024-05-09T07:54:38.089184+0000","last_fullsized":"2024-05-09T07:54:38.089184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126626+0000","last_change":"2024-05-09T07:54:37.098733+0000","last_active":"2024-05-09T07:54:38.126626+0000","last_peered":"2024-05-09T07:54:38.126626+0000","last_clean":"2024-05-09T07:54:38.126626+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T07:54:38.126626+0000","last_undegraded":"2024-05-09T07:54:38.126626+0000","last_fullsized":"2024-05-09T07:54:38.126626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:15.571989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089966+0000","last_change":"2024-05-09T07:54:36.103096+0000","last_active":"2024-05-09T07:54:38.089966+0000","last_peered":"2024-05-09T07:54:38.089966+0000","last_clean":"2024-05-09T07:54:38.089966+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T07:54:38.089966+0000","last_undegraded":"2024-05-09T07:54:38.089966+0000","last_fullsized":"2024-05-09T07:54:38.089966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127096+0000","last_change":"2024-05-09T07:54:37.101875+0000","last_active":"2024-05-09T07:54:38.127096+0000","last_peered":"2024-05-09T07:54:38.127096+0000","last_clean":"2024-05-09T07:54:38.127096+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T07:54:38.127096+0000","last_undegraded":"2024-05-09T07:54:38.127096+0000","last_fullsized":"2024-05-09T07:54:38.127096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114462+0000","last_change":"2024-05-09T07:54:36.090977+0000","last_active":"2024-05-09T07:54:38.114462+0000","last_peered":"2024-05-09T07:54:38.114462+0000","last_clean":"2024-05-09T07:54:38.114462+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T07:54:38.114462+0000","last_undegraded":"2024-05-09T07:54:38.114462+0000","last_fullsized":"2024-05-09T07:54:38.114462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:17.768144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114204+0000","last_change":"2024-05-09T07:54:37.105813+0000","last_active":"2024-05-09T07:54:38.114204+0000","last_peered":"2024-05-09T07:54:38.114204+0000","last_clean":"2024-05-09T07:54:38.114204+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T07:54:38.114204+0000","last_undegraded":"2024-05-09T07:54:38.114204+0000","last_fullsized":"2024-05-09T07:54:38.114204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:02.185354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089886+0000","last_change":"2024-05-09T07:54:36.102510+0000","last_active":"2024-05-09T07:54:38.089886+0000","last_peered":"2024-05-09T07:54:38.089886+0000","last_clean":"2024-05-09T07:54:38.089886+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T07:54:38.089886+0000","last_undegraded":"2024-05-09T07:54:38.089886+0000","last_fullsized":"2024-05-09T07:54:38.089886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126997+0000","last_change":"2024-05-09T07:54:37.105015+0000","last_active":"2024-05-09T07:54:38.126997+0000","last_peered":"2024-05-09T07:54:38.126997+0000","last_clean":"2024-05-09T07:54:38.126997+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T07:54:38.126997+0000","last_undegraded":"2024-05-09T07:54:38.126997+0000","last_fullsized":"2024-05-09T07:54:38.126997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089058+0000","last_change":"2024-05-09T07:54:36.103721+0000","last_active":"2024-05-09T07:54:38.089058+0000","last_peered":"2024-05-09T07:54:38.089058+0000","last_clean":"2024-05-09T07:54:38.089058+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T07:54:38.089058+0000","last_undegraded":"2024-05-09T07:54:38.089058+0000","last_fullsized":"2024-05-09T07:54:38.089058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088980+0000","last_change":"2024-05-09T07:54:37.111215+0000","last_active":"2024-05-09T07:54:38.088980+0000","last_peered":"2024-05-09T07:54:38.088980+0000","last_clean":"2024-05-09T07:54:38.088980+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T07:54:38.088980+0000","last_undegraded":"2024-05-09T07:54:38.088980+0000","last_fullsized":"2024-05-09T07:54:38.088980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125695+0000","last_change":"2024-05-09T07:54:36.098598+0000","last_active":"2024-05-09T07:54:38.125695+0000","last_peered":"2024-05-09T07:54:38.125695+0000","last_clean":"2024-05-09T07:54:38.125695+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T07:54:38.125695+0000","last_undegraded":"2024-05-09T07:54:38.125695+0000","last_fullsized":"2024-05-09T07:54:38.125695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126550+0000","last_change":"2024-05-09T07:54:37.102764+0000","last_active":"2024-05-09T07:54:38.126550+0000","last_peered":"2024-05-09T07:54:38.126550+0000","last_clean":"2024-05-09T07:54:38.126550+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T07:54:38.126550+0000","last_undegraded":"2024-05-09T07:54:38.126550+0000","last_fullsized":"2024-05-09T07:54:38.126550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126466+0000","last_change":"2024-05-09T07:54:36.092365+0000","last_active":"2024-05-09T07:54:38.126466+0000","last_peered":"2024-05-09T07:54:38.126466+0000","last_clean":"2024-05-09T07:54:38.126466+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T07:54:38.126466+0000","last_undegraded":"2024-05-09T07:54:38.126466+0000","last_fullsized":"2024-05-09T07:54:38.126466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127009+0000","last_change":"2024-05-09T07:54:37.100214+0000","last_active":"2024-05-09T07:54:38.127009+0000","last_peered":"2024-05-09T07:54:38.127009+0000","last_clean":"2024-05-09T07:54:38.127009+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T07:54:38.127009+0000","last_undegraded":"2024-05-09T07:54:38.127009+0000","last_fullsized":"2024-05-09T07:54:38.127009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126065+0000","last_change":"2024-05-09T07:54:36.100004+0000","last_active":"2024-05-09T07:54:38.126065+0000","last_peered":"2024-05-09T07:54:38.126065+0000","last_clean":"2024-05-09T07:54:38.126065+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T07:54:38.126065+0000","last_undegraded":"2024-05-09T07:54:38.126065+0000","last_fullsized":"2024-05-09T07:54:38.126065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127108+0000","last_change":"2024-05-09T07:54:37.100879+0000","last_active":"2024-05-09T07:54:38.127108+0000","last_peered":"2024-05-09T07:54:38.127108+0000","last_clean":"2024-05-09T07:54:38.127108+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T07:54:38.127108+0000","last_undegraded":"2024-05-09T07:54:38.127108+0000","last_fullsized":"2024-05-09T07:54:38.127108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089145+0000","last_change":"2024-05-09T07:54:36.099594+0000","last_active":"2024-05-09T07:54:38.089145+0000","last_peered":"2024-05-09T07:54:38.089145+0000","last_clean":"2024-05-09T07:54:38.089145+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T07:54:38.089145+0000","last_undegraded":"2024-05-09T07:54:38.089145+0000","last_fullsized":"2024-05-09T07:54:38.089145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090354+0000","last_change":"2024-05-09T07:54:37.103885+0000","last_active":"2024-05-09T07:54:38.090354+0000","last_peered":"2024-05-09T07:54:38.090354+0000","last_clean":"2024-05-09T07:54:38.090354+0000","last_became_active":"2024-05-09T07:54:37.103150+0000","last_became_peered":"2024-05-09T07:54:37.103150+0000","last_unstale":"2024-05-09T07:54:38.090354+0000","last_undegraded":"2024-05-09T07:54:38.090354+0000","last_fullsized":"2024-05-09T07:54:38.090354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125835+0000","last_change":"2024-05-09T07:54:36.097398+0000","last_active":"2024-05-09T07:54:38.125835+0000","last_peered":"2024-05-09T07:54:38.125835+0000","last_clean":"2024-05-09T07:54:38.125835+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T07:54:38.125835+0000","last_undegraded":"2024-05-09T07:54:38.125835+0000","last_fullsized":"2024-05-09T07:54:38.125835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127276+0000","last_change":"2024-05-09T07:54:37.108574+0000","last_active":"2024-05-09T07:54:38.127276+0000","last_peered":"2024-05-09T07:54:38.127276+0000","last_clean":"2024-05-09T07:54:38.127276+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T07:54:38.127276+0000","last_undegraded":"2024-05-09T07:54:38.127276+0000","last_fullsized":"2024-05-09T07:54:38.127276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089307+0000","last_change":"2024-05-09T07:54:36.097635+0000","last_active":"2024-05-09T07:54:38.089307+0000","last_peered":"2024-05-09T07:54:38.089307+0000","last_clean":"2024-05-09T07:54:38.089307+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T07:54:38.089307+0000","last_undegraded":"2024-05-09T07:54:38.089307+0000","last_fullsized":"2024-05-09T07:54:38.089307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125983+0000","last_change":"2024-05-09T07:54:37.111470+0000","last_active":"2024-05-09T07:54:38.125983+0000","last_peered":"2024-05-09T07:54:38.125983+0000","last_clean":"2024-05-09T07:54:38.125983+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T07:54:38.125983+0000","last_undegraded":"2024-05-09T07:54:38.125983+0000","last_fullsized":"2024-05-09T07:54:38.125983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126209+0000","last_change":"2024-05-09T07:54:36.107162+0000","last_active":"2024-05-09T07:54:38.126209+0000","last_peered":"2024-05-09T07:54:38.126209+0000","last_clean":"2024-05-09T07:54:38.126209+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T07:54:38.126209+0000","last_undegraded":"2024-05-09T07:54:38.126209+0000","last_fullsized":"2024-05-09T07:54:38.126209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114106+0000","last_change":"2024-05-09T07:54:37.102062+0000","last_active":"2024-05-09T07:54:38.114106+0000","last_peered":"2024-05-09T07:54:38.114106+0000","last_clean":"2024-05-09T07:54:38.114106+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T07:54:38.114106+0000","last_undegraded":"2024-05-09T07:54:38.114106+0000","last_fullsized":"2024-05-09T07:54:38.114106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:32.555846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125875+0000","last_change":"2024-05-09T07:54:36.100227+0000","last_active":"2024-05-09T07:54:38.125875+0000","last_peered":"2024-05-09T07:54:38.125875+0000","last_clean":"2024-05-09T07:54:38.125875+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T07:54:38.125875+0000","last_undegraded":"2024-05-09T07:54:38.125875+0000","last_fullsized":"2024-05-09T07:54:38.125875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089178+0000","last_change":"2024-05-09T07:54:37.109167+0000","last_active":"2024-05-09T07:54:38.089178+0000","last_peered":"2024-05-09T07:54:38.089178+0000","last_clean":"2024-05-09T07:54:38.089178+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T07:54:38.089178+0000","last_undegraded":"2024-05-09T07:54:38.089178+0000","last_fullsized":"2024-05-09T07:54:38.089178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090002+0000","last_change":"2024-05-09T07:54:36.100426+0000","last_active":"2024-05-09T07:54:38.090002+0000","last_peered":"2024-05-09T07:54:38.090002+0000","last_clean":"2024-05-09T07:54:38.090002+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T07:54:38.090002+0000","last_undegraded":"2024-05-09T07:54:38.090002+0000","last_fullsized":"2024-05-09T07:54:38.090002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126610+0000","last_change":"2024-05-09T07:54:37.108794+0000","last_active":"2024-05-09T07:54:38.126610+0000","last_peered":"2024-05-09T07:54:38.126610+0000","last_clean":"2024-05-09T07:54:38.126610+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T07:54:38.126610+0000","last_undegraded":"2024-05-09T07:54:38.126610+0000","last_fullsized":"2024-05-09T07:54:38.126610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:43.498827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089162+0000","last_change":"2024-05-09T07:54:36.104155+0000","last_active":"2024-05-09T07:54:38.089162+0000","last_peered":"2024-05-09T07:54:38.089162+0000","last_clean":"2024-05-09T07:54:38.089162+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T07:54:38.089162+0000","last_undegraded":"2024-05-09T07:54:38.089162+0000","last_fullsized":"2024-05-09T07:54:38.089162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090218+0000","last_change":"2024-05-09T07:54:37.103562+0000","last_active":"2024-05-09T07:54:38.090218+0000","last_peered":"2024-05-09T07:54:38.090218+0000","last_clean":"2024-05-09T07:54:38.090218+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T07:54:38.090218+0000","last_undegraded":"2024-05-09T07:54:38.090218+0000","last_fullsized":"2024-05-09T07:54:38.090218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127376+0000","last_change":"2024-05-09T07:54:36.106399+0000","last_active":"2024-05-09T07:54:38.127376+0000","last_peered":"2024-05-09T07:54:38.127376+0000","last_clean":"2024-05-09T07:54:38.127376+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T07:54:38.127376+0000","last_undegraded":"2024-05-09T07:54:38.127376+0000","last_fullsized":"2024-05-09T07:54:38.127376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089072+0000","last_change":"2024-05-09T07:54:37.105988+0000","last_active":"2024-05-09T07:54:38.089072+0000","last_peered":"2024-05-09T07:54:38.089072+0000","last_clean":"2024-05-09T07:54:38.089072+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T07:54:38.089072+0000","last_undegraded":"2024-05-09T07:54:38.089072+0000","last_fullsized":"2024-05-09T07:54:38.089072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.102035+0000","last_change":"2024-05-09T07:54:36.101002+0000","last_active":"2024-05-09T07:54:38.102035+0000","last_peered":"2024-05-09T07:54:38.102035+0000","last_clean":"2024-05-09T07:54:38.102035+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T07:54:38.102035+0000","last_undegraded":"2024-05-09T07:54:38.102035+0000","last_fullsized":"2024-05-09T07:54:38.102035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126405+0000","last_change":"2024-05-09T07:54:37.100183+0000","last_active":"2024-05-09T07:54:38.126405+0000","last_peered":"2024-05-09T07:54:38.126405+0000","last_clean":"2024-05-09T07:54:38.126405+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T07:54:38.126405+0000","last_undegraded":"2024-05-09T07:54:38.126405+0000","last_fullsized":"2024-05-09T07:54:38.126405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089901+0000","last_change":"2024-05-09T07:54:36.105813+0000","last_active":"2024-05-09T07:54:38.089901+0000","last_peered":"2024-05-09T07:54:38.089901+0000","last_clean":"2024-05-09T07:54:38.089901+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T07:54:38.089901+0000","last_undegraded":"2024-05-09T07:54:38.089901+0000","last_fullsized":"2024-05-09T07:54:38.089901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114359+0000","last_change":"2024-05-09T07:54:37.107782+0000","last_active":"2024-05-09T07:54:38.114359+0000","last_peered":"2024-05-09T07:54:38.114359+0000","last_clean":"2024-05-09T07:54:38.114359+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T07:54:38.114359+0000","last_undegraded":"2024-05-09T07:54:38.114359+0000","last_fullsized":"2024-05-09T07:54:38.114359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125962+0000","last_change":"2024-05-09T07:54:36.106409+0000","last_active":"2024-05-09T07:54:38.125962+0000","last_peered":"2024-05-09T07:54:38.125962+0000","last_clean":"2024-05-09T07:54:38.125962+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T07:54:38.125962+0000","last_undegraded":"2024-05-09T07:54:38.125962+0000","last_fullsized":"2024-05-09T07:54:38.125962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126537+0000","last_change":"2024-05-09T07:54:37.104920+0000","last_active":"2024-05-09T07:54:38.126537+0000","last_peered":"2024-05-09T07:54:38.126537+0000","last_clean":"2024-05-09T07:54:38.126537+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T07:54:38.126537+0000","last_undegraded":"2024-05-09T07:54:38.126537+0000","last_fullsized":"2024-05-09T07:54:38.126537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089089+0000","last_change":"2024-05-09T07:54:36.105662+0000","last_active":"2024-05-09T07:54:38.089089+0000","last_peered":"2024-05-09T07:54:38.089089+0000","last_clean":"2024-05-09T07:54:38.089089+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T07:54:38.089089+0000","last_undegraded":"2024-05-09T07:54:38.089089+0000","last_fullsized":"2024-05-09T07:54:38.089089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125906+0000","last_change":"2024-05-09T07:54:37.103640+0000","last_active":"2024-05-09T07:54:38.125906+0000","last_peered":"2024-05-09T07:54:38.125906+0000","last_clean":"2024-05-09T07:54:38.125906+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T07:54:38.125906+0000","last_undegraded":"2024-05-09T07:54:38.125906+0000","last_fullsized":"2024-05-09T07:54:38.125906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089139+0000","last_change":"2024-05-09T07:54:36.102636+0000","last_active":"2024-05-09T07:54:38.089139+0000","last_peered":"2024-05-09T07:54:38.089139+0000","last_clean":"2024-05-09T07:54:38.089139+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T07:54:38.089139+0000","last_undegraded":"2024-05-09T07:54:38.089139+0000","last_fullsized":"2024-05-09T07:54:38.089139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126076+0000","last_change":"2024-05-09T07:54:37.113734+0000","last_active":"2024-05-09T07:54:38.126076+0000","last_peered":"2024-05-09T07:54:38.126076+0000","last_clean":"2024-05-09T07:54:38.126076+0000","last_became_active":"2024-05-09T07:54:37.113448+0000","last_became_peered":"2024-05-09T07:54:37.113448+0000","last_unstale":"2024-05-09T07:54:38.126076+0000","last_undegraded":"2024-05-09T07:54:38.126076+0000","last_fullsized":"2024-05-09T07:54:38.126076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127166+0000","last_change":"2024-05-09T07:54:36.104367+0000","last_active":"2024-05-09T07:54:38.127166+0000","last_peered":"2024-05-09T07:54:38.127166+0000","last_clean":"2024-05-09T07:54:38.127166+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T07:54:38.127166+0000","last_undegraded":"2024-05-09T07:54:38.127166+0000","last_fullsized":"2024-05-09T07:54:38.127166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088985+0000","last_change":"2024-05-09T07:54:37.111038+0000","last_active":"2024-05-09T07:54:38.088985+0000","last_peered":"2024-05-09T07:54:38.088985+0000","last_clean":"2024-05-09T07:54:38.088985+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T07:54:38.088985+0000","last_undegraded":"2024-05-09T07:54:38.088985+0000","last_fullsized":"2024-05-09T07:54:38.088985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089727+0000","last_change":"2024-05-09T07:54:37.091699+0000","last_active":"2024-05-09T07:54:38.089727+0000","last_peered":"2024-05-09T07:54:38.089727+0000","last_clean":"2024-05-09T07:54:38.089727+0000","last_became_active":"2024-05-09T07:54:37.091280+0000","last_became_peered":"2024-05-09T07:54:37.091280+0000","last_unstale":"2024-05-09T07:54:38.089727+0000","last_undegraded":"2024-05-09T07:54:38.089727+0000","last_fullsized":"2024-05-09T07:54:38.089727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127058+0000","last_change":"2024-05-09T07:54:36.105726+0000","last_active":"2024-05-09T07:54:38.127058+0000","last_peered":"2024-05-09T07:54:38.127058+0000","last_clean":"2024-05-09T07:54:38.127058+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T07:54:38.127058+0000","last_undegraded":"2024-05-09T07:54:38.127058+0000","last_fullsized":"2024-05-09T07:54:38.127058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090261+0000","last_change":"2024-05-09T07:54:37.092061+0000","last_active":"2024-05-09T07:54:38.090261+0000","last_peered":"2024-05-09T07:54:38.090261+0000","last_clean":"2024-05-09T07:54:38.090261+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T07:54:38.090261+0000","last_undegraded":"2024-05-09T07:54:38.090261+0000","last_fullsized":"2024-05-09T07:54:38.090261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127214+0000","last_change":"2024-05-09T07:54:36.106635+0000","last_active":"2024-05-09T07:54:38.127214+0000","last_peered":"2024-05-09T07:54:38.127214+0000","last_clean":"2024-05-09T07:54:38.127214+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T07:54:38.127214+0000","last_undegraded":"2024-05-09T07:54:38.127214+0000","last_fullsized":"2024-05-09T07:54:38.127214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114272+0000","last_change":"2024-05-09T07:54:37.108470+0000","last_active":"2024-05-09T07:54:38.114272+0000","last_peered":"2024-05-09T07:54:38.114272+0000","last_clean":"2024-05-09T07:54:38.114272+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T07:54:38.114272+0000","last_undegraded":"2024-05-09T07:54:38.114272+0000","last_fullsized":"2024-05-09T07:54:38.114272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126415+0000","last_change":"2024-05-09T07:54:36.102502+0000","last_active":"2024-05-09T07:54:38.126415+0000","last_peered":"2024-05-09T07:54:38.126415+0000","last_clean":"2024-05-09T07:54:38.126415+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T07:54:38.126415+0000","last_undegraded":"2024-05-09T07:54:38.126415+0000","last_fullsized":"2024-05-09T07:54:38.126415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126360+0000","last_change":"2024-05-09T07:54:37.104598+0000","last_active":"2024-05-09T07:54:38.126360+0000","last_peered":"2024-05-09T07:54:38.126360+0000","last_clean":"2024-05-09T07:54:38.126360+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T07:54:38.126360+0000","last_undegraded":"2024-05-09T07:54:38.126360+0000","last_fullsized":"2024-05-09T07:54:38.126360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114410+0000","last_change":"2024-05-09T07:54:36.101744+0000","last_active":"2024-05-09T07:54:38.114410+0000","last_peered":"2024-05-09T07:54:38.114410+0000","last_clean":"2024-05-09T07:54:38.114410+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T07:54:38.114410+0000","last_undegraded":"2024-05-09T07:54:38.114410+0000","last_fullsized":"2024-05-09T07:54:38.114410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":798720,"data_stored":659695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":76657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":70357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T07:54:41.126 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-09T07:54:41.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.245+0000 7f99fe472640 1 Processor -- start 2024-05-09T07:54:41.260 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.245+0000 7f99fe472640 1 -- start start 2024-05-09T07:54:41.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99fe472640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99f80afab0 0x7f99f814bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99fe472640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 0x7f99f814e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99fe472640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99f80b0890 con 0x7f99f806cbb0 2024-05-09T07:54:41.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99fe472640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f99f80b0400 con 0x7f99f80afab0 2024-05-09T07:54:41.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99fe472640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f99f80add80 con 0x7f99f806cf90 2024-05-09T07:54:41.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99effff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99f80afab0 0x7f99f814bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99fca0f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 0x7f99f814e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99f7fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f99f806cbb0 0x7f99f80ae9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:56140/0 (socket says 172.21.15.87:56140) 2024-05-09T07:54:41.262 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99effff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99f80afab0 0x7f99f814bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:34876/0 (socket says 172.21.15.87:34876) 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.246+0000 7f99f7fff640 1 -- 172.21.15.87:0/4052682982 learned_addr learned my addr 172.21.15.87:0/4052682982 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.247+0000 7f99effff640 1 -- 172.21.15.87:0/4052682982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 msgr2=0x7f99f814e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.247+0000 7f99effff640 1 --2- 172.21.15.87:0/4052682982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 0x7f99f814e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.247+0000 7f99effff640 1 -- 172.21.15.87:0/4052682982 >> v1:172.21.15.110:6789/0 conn(0x7f99f806cbb0 legacy=0x7f99f80ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.247+0000 7f99f77fe640 1 -- 172.21.15.87:0/4052682982 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4019822536 0 0) 0x7f99f80b0890 con 0x7f99f806cbb0 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.247+0000 7f99effff640 1 -- 172.21.15.87:0/4052682982 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f80af0b0 con 0x7f99f80afab0 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.247+0000 7f99effff640 1 --2- 172.21.15.87:0/4052682982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f80afab0 0x7f99f814bbd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99e00097a0 tx=0x7f99e002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6148ffc9f9ffb8c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.247+0000 7f99f77fe640 1 -- 172.21.15.87:0/4052682982 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0037070 con 0x7f99f80afab0 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.247+0000 7f99f77fe640 1 -- 172.21.15.87:0/4052682982 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e002ae50 con 0x7f99f80afab0 2024-05-09T07:54:41.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.247+0000 7f99f77fe640 1 -- 172.21.15.87:0/4052682982 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0032660 con 0x7f99f80afab0 2024-05-09T07:54:41.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.248+0000 7f99fe472640 1 -- 172.21.15.87:0/4052682982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f80afab0 msgr2=0x7f99f814bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.248+0000 7f99fe472640 1 --2- 172.21.15.87:0/4052682982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f80afab0 0x7f99f814bbd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f99e00097a0 tx=0x7f99e002a100 comp rx=0 tx=0).stop 2024-05-09T07:54:41.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.248+0000 7f99fe472640 1 -- 172.21.15.87:0/4052682982 shutdown_connections 2024-05-09T07:54:41.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.248+0000 7f99fe472640 1 --2- 172.21.15.87:0/4052682982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 0x7f99f814e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.248+0000 7f99fe472640 1 --2- 172.21.15.87:0/4052682982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f80afab0 0x7f99f814bbd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.248+0000 7f99fe472640 1 -- 172.21.15.87:0/4052682982 >> 172.21.15.87:0/4052682982 conn(0x7f99f80b8f40 msgr2=0x7f99f80b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:41.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.248+0000 7f99fe472640 1 -- 172.21.15.87:0/4052682982 shutdown_connections 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.248+0000 7f99fe472640 1 -- 172.21.15.87:0/4052682982 wait complete. 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.249+0000 7f99fe472640 1 Processor -- start 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.249+0000 7f99fe472640 1 -- start start 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99fe472640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f806cbb0 0x7f99f81dbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99fe472640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 0x7f99f809af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99fe472640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f80afab0 0x7f99f809b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99fe472640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f99f80ae240 con 0x7f99f806cbb0 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99fe472640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f99f80b5610 con 0x7f99f80afab0 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99fe472640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f99f80ae3c0 con 0x7f99f806cf90 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f806cbb0 0x7f99f81dbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99f7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f806cbb0 0x7f99f81dbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47368/0 (socket says 172.21.15.87:47368) 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99f7fff640 1 -- 172.21.15.87:0/1217649670 learned_addr learned my addr 172.21.15.87:0/1217649670 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99fca0f640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f80afab0 0x7f99f809b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99effff640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 0x7f99f809af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99f7fff640 1 -- 172.21.15.87:0/1217649670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 msgr2=0x7f99f809af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99f7fff640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 0x7f99f809af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99f7fff640 1 -- 172.21.15.87:0/1217649670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f80afab0 msgr2=0x7f99f809b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99f7fff640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f80afab0 0x7f99f809b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99f7fff640 1 -- 172.21.15.87:0/1217649670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f81dc320 con 0x7f99f806cbb0 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.250+0000 7f99f7fff640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f806cbb0 0x7f99f81dbde0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c500 tx=0x7f99e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.251+0000 7f99f57fa640 1 -- 172.21.15.87:0/1217649670 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8018070 con 0x7f99f806cbb0 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.251+0000 7f99f57fa640 1 -- 172.21.15.87:0/1217649670 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e8007580 con 0x7f99f806cbb0 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.251+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f8071fe0 con 0x7f99f806cbb0 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.251+0000 7f99f57fa640 1 -- 172.21.15.87:0/1217649670 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8004a20 con 0x7f99f806cbb0 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.251+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f809c830 con 0x7f99f806cbb0 2024-05-09T07:54:41.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.251+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f80691f0 con 0x7f99f806cbb0 2024-05-09T07:54:41.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.252+0000 7f99f57fa640 1 -- 172.21.15.87:0/1217649670 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99e801b070 con 0x7f99f806cbb0 2024-05-09T07:54:41.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.252+0000 7f99f57fa640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f99d806be30 0x7f99d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.253+0000 7f99f57fa640 1 -- 172.21.15.87:0/1217649670 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f99e808a0d0 con 0x7f99f806cbb0 2024-05-09T07:54:41.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.253+0000 7f99effff640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f99d806be30 0x7f99d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.253+0000 7f99effff640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f99d806be30 0x7f99d806e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99e0034000 tx=0x7f99e002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:41.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.257+0000 7f99f57fa640 1 -- 172.21.15.87:0/1217649670 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f99e8058b10 con 0x7f99f806cbb0 2024-05-09T07:54:41.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.495+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f99f809cde0 con 0x7f99f806cbb0 2024-05-09T07:54:41.510 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.496+0000 7f99f57fa640 1 -- 172.21.15.87:0/1217649670 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1011 (secure 0 0 0) 0x7f99e8058410 con 0x7f99f806cbb0 2024-05-09T07:54:41.511 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:41.511 INFO:teuthology.orchestra.run.smithi087.stdout:{"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1715241264,"num_in_osds":8,"osd_in_since":1715241254,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":241344512,"bytes_avail":772852768768,"bytes_total":773094113280,"write_bytes_sec":2466,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4269}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-09T07:54:12.685223+0000","services":{}},"progress_events":{}} 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f99d806be30 msgr2=0x7f99d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f99d806be30 0x7f99d806e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99e0034000 tx=0x7f99e002e000 comp rx=0 tx=0).stop 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f806cbb0 msgr2=0x7f99f81dbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f806cbb0 0x7f99f81dbde0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f99e800c500 tx=0x7f99e800c9c0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 shutdown_connections 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f99d806be30 0x7f99d806e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f806cf90 0x7f99f809af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f80afab0 0x7f99f809b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 --2- 172.21.15.87:0/1217649670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99f806cbb0 0x7f99f81dbde0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 >> 172.21.15.87:0/1217649670 conn(0x7f99f80b8f40 msgr2=0x7f99f80b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 shutdown_connections 2024-05-09T07:54:41.513 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.498+0000 7f99fe472640 1 -- 172.21.15.87:0/1217649670 wait complete. 2024-05-09T07:54:41.523 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-09T07:54:41.524 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T07:54:41.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.608+0000 7f72f055c640 1 Processor -- start 2024-05-09T07:54:41.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.608+0000 7f72f055c640 1 -- start start 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.608+0000 7f72f055c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80b5330 0x7f72e80b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.608+0000 7f72f055c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e80b6240 con 0x7f72e80b5e60 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.608+0000 7f72f055c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e80b1860 con 0x7f72e80b2940 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.608+0000 7f72f055c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f72e80b0470 con 0x7f72e80b5330 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ee2f8640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f72e80b5e60 0x7f72e80b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43542/0 (socket says 172.21.15.87:43542) 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ee2f8640 1 -- 172.21.15.87:0/986096176 learned_addr learned my addr 172.21.15.87:0/986096176 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696791803 0 0) 0x7f72e80b6240 con 0x7f72e80b5e60 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72d4003520 con 0x7f72e80b5e60 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72edaf7640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80b5330 0x7f72e80b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.626 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 54041780 0 0) 0x7f72d4003520 con 0x7f72e80b5e60 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80b5330 msgr2=0x7f72e80b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80b5330 0x7f72e80b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 >> v1:172.21.15.110:6789/0 conn(0x7f72e80b2940 legacy=0x7f72e8147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e80afd40 con 0x7f72e80b5e60 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f72e4001670 con 0x7f72e80b5e60 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 >> v1:172.21.15.87:6789/0 conn(0x7f72e80b5e60 legacy=0x7f72e80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d40039e0 0x7f72d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80b5330 0x7f72d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d4004d40 0x7f72d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72d400bb70 con 0x7f72d4004d40 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f72d400df30 con 0x7f72d40039e0 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f72d400e130 con 0x7f72e80b5330 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72eeaf9640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d4004d40 0x7f72d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72ee2f8640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d40039e0 0x7f72d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.609+0000 7f72edaf7640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80b5330 0x7f72d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.610+0000 7f72eeaf9640 1 -- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80b5330 msgr2=0x7f72d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.610+0000 7f72eeaf9640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80b5330 0x7f72d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.610+0000 7f72eeaf9640 1 -- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d40039e0 msgr2=0x7f72d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.610+0000 7f72eeaf9640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d40039e0 0x7f72d4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.610+0000 7f72eeaf9640 1 -- 172.21.15.87:0/986096176 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d4003520 con 0x7f72d4004d40 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.610+0000 7f72eeaf9640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d4004d40 0x7f72d40051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72e0001e20 tx=0x7f72d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711cdd04f7732eb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.610+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0001a70 con 0x7f72d4004d40 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.610+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e002ae40 con 0x7f72d4004d40 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.610+0000 7f72ed2f6640 1 -- 172.21.15.87:0/986096176 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0003bb0 con 0x7f72d4004d40 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.611+0000 7f72f055c640 1 -- 172.21.15.87:0/986096176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d4004d40 msgr2=0x7f72d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.611+0000 7f72f055c640 1 --2- 172.21.15.87:0/986096176 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72d4004d40 0x7f72d40051c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72e0001e20 tx=0x7f72d4005830 comp rx=0 tx=0).stop 2024-05-09T07:54:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.611+0000 7f72eeaf9640 1 -- 172.21.15.87:0/986096176 reap_dead start 2024-05-09T07:54:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.611+0000 7f72f055c640 1 -- 172.21.15.87:0/986096176 shutdown_connections 2024-05-09T07:54:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.611+0000 7f72f055c640 1 -- 172.21.15.87:0/986096176 >> 172.21.15.87:0/986096176 conn(0x7f72e806c6a0 msgr2=0x7f72e806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.611+0000 7f72f055c640 1 -- 172.21.15.87:0/986096176 shutdown_connections 2024-05-09T07:54:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.611+0000 7f72f055c640 1 -- 172.21.15.87:0/986096176 wait complete. 2024-05-09T07:54:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.612+0000 7f72f055c640 1 Processor -- start 2024-05-09T07:54:41.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.612+0000 7f72f055c640 1 -- start start 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.612+0000 7f72f055c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d4004d40 0x7f72e813ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72f055c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e81cf670 0x7f72e80b9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72f055c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e80b8520 0x7f72e81ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72f055c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f72e81482e0 con 0x7f72e80b8520 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72f055c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f72e80b1580 con 0x7f72d4004d40 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72f055c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f72e8148460 con 0x7f72e81cf670 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72eeaf9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e80b8520 0x7f72e81ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72eeaf9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e80b8520 0x7f72e81ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55442/0 (socket says 172.21.15.87:55442) 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72eeaf9640 1 -- 172.21.15.87:0/1009557078 learned_addr learned my addr 172.21.15.87:0/1009557078 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72ee2f8640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d4004d40 0x7f72e813ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72edaf7640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e81cf670 0x7f72e80b9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72eeaf9640 1 -- 172.21.15.87:0/1009557078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e81cf670 msgr2=0x7f72e80b9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72eeaf9640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e81cf670 0x7f72e80b9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72eeaf9640 1 -- 172.21.15.87:0/1009557078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d4004d40 msgr2=0x7f72e813ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72eeaf9640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d4004d40 0x7f72e813ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72eeaf9640 1 -- 172.21.15.87:0/1009557078 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e80b9980 con 0x7f72e80b8520 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72eeaf9640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e80b8520 0x7f72e81ce4b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72e0001f40 tx=0x7f72e00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72deffd640 1 -- 172.21.15.87:0/1009557078 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0042070 con 0x7f72e80b8520 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72deffd640 1 -- 172.21.15.87:0/1009557078 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e0006b50 con 0x7f72e80b8520 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e813c830 con 0x7f72e80b8520 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72deffd640 1 -- 172.21.15.87:0/1009557078 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0037040 con 0x7f72e80b8520 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.613+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e81cfe50 con 0x7f72e80b8520 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.614+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e80691f0 con 0x7f72e80b8520 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.615+0000 7f72deffd640 1 -- 172.21.15.87:0/1009557078 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72e0045070 con 0x7f72e80b8520 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.615+0000 7f72deffd640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f72cc06be30 0x7f72cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.615+0000 7f72deffd640 1 -- 172.21.15.87:0/1009557078 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f72e00aa620 con 0x7f72e80b8520 2024-05-09T07:54:41.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.615+0000 7f72ee2f8640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f72cc06be30 0x7f72cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:41.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.615+0000 7f72ee2f8640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f72cc06be30 0x7f72cc06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f72e8146890 tx=0x7f72e40078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:41.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.619+0000 7f72deffd640 1 -- 172.21.15.87:0/1009557078 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f72e80b9980 con 0x7f72e80b8520 2024-05-09T07:54:41.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.788+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f72e80b7af0 con 0x7f72cc06be30 2024-05-09T07:54:41.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.794+0000 7f72deffd640 1 -- 172.21.15.87:0/1009557078 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f72e80b7af0 con 0x7f72cc06be30 2024-05-09T07:54:41.811 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:41.812 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T07:54:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f72cc06be30 msgr2=0x7f72cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f72cc06be30 0x7f72cc06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f72e8146890 tx=0x7f72e40078f0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e80b8520 msgr2=0x7f72e81ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e80b8520 0x7f72e81ce4b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f72e0001f40 tx=0x7f72e00014a0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 shutdown_connections 2024-05-09T07:54:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f72cc06be30 0x7f72cc06e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e81cf670 0x7f72e80b9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f72e80b8520 0x7f72e81ce4b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 --2- 172.21.15.87:0/1009557078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72d4004d40 0x7f72e813ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:41.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 >> 172.21.15.87:0/1009557078 conn(0x7f72e806c6a0 msgr2=0x7f72e80b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:41.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 shutdown_connections 2024-05-09T07:54:41.815 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:41.797+0000 7f72f055c640 1 -- 172.21.15.87:0/1009557078 wait complete. 2024-05-09T07:54:41.822 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-09T07:54:40.892345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235688,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739032,"statfs":{"total":773094113280,"available":772852768768,"internally_reserved":0,"allocated":2932736,"data_stored":1773316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.813171"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126816+0000","last_change":"2024-05-09T07:54:37.107065+0000","last_active":"2024-05-09T07:54:38.126816+0000","last_peered":"2024-05-09T07:54:38.126816+0000","last_clean":"2024-05-09T07:54:38.126816+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T07:54:38.126816+0000","last_undegraded":"2024-05-09T07:54:38.126816+0000","last_fullsized":"2024-05-09T07:54:38.126816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089122+0000","last_change":"2024-05-09T07:54:37.109460+0000","last_active":"2024-05-09T07:54:38.089122+0000","last_peered":"2024-05-09T07:54:38.089122+0000","last_clean":"2024-05-09T07:54:38.089122+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T07:54:38.089122+0000","last_undegraded":"2024-05-09T07:54:38.089122+0000","last_fullsized":"2024-05-09T07:54:38.089122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114255+0000","last_change":"2024-05-09T07:54:37.108923+0000","last_active":"2024-05-09T07:54:38.114255+0000","last_peered":"2024-05-09T07:54:38.114255+0000","last_clean":"2024-05-09T07:54:38.114255+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T07:54:38.114255+0000","last_undegraded":"2024-05-09T07:54:38.114255+0000","last_fullsized":"2024-05-09T07:54:38.114255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090307+0000","last_change":"2024-05-09T07:54:37.104600+0000","last_active":"2024-05-09T07:54:38.090307+0000","last_peered":"2024-05-09T07:54:38.090307+0000","last_clean":"2024-05-09T07:54:38.090307+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T07:54:38.090307+0000","last_undegraded":"2024-05-09T07:54:38.090307+0000","last_fullsized":"2024-05-09T07:54:38.090307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126911+0000","last_change":"2024-05-09T07:54:37.104101+0000","last_active":"2024-05-09T07:54:38.126911+0000","last_peered":"2024-05-09T07:54:38.126911+0000","last_clean":"2024-05-09T07:54:38.126911+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T07:54:38.126911+0000","last_undegraded":"2024-05-09T07:54:38.126911+0000","last_fullsized":"2024-05-09T07:54:38.126911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089353+0000","last_change":"2024-05-09T07:54:37.109462+0000","last_active":"2024-05-09T07:54:38.089353+0000","last_peered":"2024-05-09T07:54:38.089353+0000","last_clean":"2024-05-09T07:54:38.089353+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T07:54:38.089353+0000","last_undegraded":"2024-05-09T07:54:38.089353+0000","last_fullsized":"2024-05-09T07:54:38.089353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126521+0000","last_change":"2024-05-09T07:54:37.114222+0000","last_active":"2024-05-09T07:54:38.126521+0000","last_peered":"2024-05-09T07:54:38.126521+0000","last_clean":"2024-05-09T07:54:38.126521+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T07:54:38.126521+0000","last_undegraded":"2024-05-09T07:54:38.126521+0000","last_fullsized":"2024-05-09T07:54:38.126521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125744+0000","last_change":"2024-05-09T07:54:37.110852+0000","last_active":"2024-05-09T07:54:38.125744+0000","last_peered":"2024-05-09T07:54:38.125744+0000","last_clean":"2024-05-09T07:54:38.125744+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T07:54:38.125744+0000","last_undegraded":"2024-05-09T07:54:38.125744+0000","last_fullsized":"2024-05-09T07:54:38.125744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126973+0000","last_change":"2024-05-09T07:54:37.106997+0000","last_active":"2024-05-09T07:54:38.126973+0000","last_peered":"2024-05-09T07:54:38.126973+0000","last_clean":"2024-05-09T07:54:38.126973+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T07:54:38.126973+0000","last_undegraded":"2024-05-09T07:54:38.126973+0000","last_fullsized":"2024-05-09T07:54:38.126973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090143+0000","last_change":"2024-05-09T07:54:37.112111+0000","last_active":"2024-05-09T07:54:38.090143+0000","last_peered":"2024-05-09T07:54:38.090143+0000","last_clean":"2024-05-09T07:54:38.090143+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T07:54:38.090143+0000","last_undegraded":"2024-05-09T07:54:38.090143+0000","last_fullsized":"2024-05-09T07:54:38.090143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089595+0000","last_change":"2024-05-09T07:54:37.111412+0000","last_active":"2024-05-09T07:54:38.089595+0000","last_peered":"2024-05-09T07:54:38.089595+0000","last_clean":"2024-05-09T07:54:38.089595+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T07:54:38.089595+0000","last_undegraded":"2024-05-09T07:54:38.089595+0000","last_fullsized":"2024-05-09T07:54:38.089595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126529+0000","last_change":"2024-05-09T07:54:37.103229+0000","last_active":"2024-05-09T07:54:38.126529+0000","last_peered":"2024-05-09T07:54:38.126529+0000","last_clean":"2024-05-09T07:54:38.126529+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T07:54:38.126529+0000","last_undegraded":"2024-05-09T07:54:38.126529+0000","last_fullsized":"2024-05-09T07:54:38.126529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125825+0000","last_change":"2024-05-09T07:54:37.104238+0000","last_active":"2024-05-09T07:54:38.125825+0000","last_peered":"2024-05-09T07:54:38.125825+0000","last_clean":"2024-05-09T07:54:38.125825+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T07:54:38.125825+0000","last_undegraded":"2024-05-09T07:54:38.125825+0000","last_fullsized":"2024-05-09T07:54:38.125825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114110+0000","last_change":"2024-05-09T07:54:37.105958+0000","last_active":"2024-05-09T07:54:38.114110+0000","last_peered":"2024-05-09T07:54:38.114110+0000","last_clean":"2024-05-09T07:54:38.114110+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T07:54:38.114110+0000","last_undegraded":"2024-05-09T07:54:38.114110+0000","last_fullsized":"2024-05-09T07:54:38.114110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:38.316625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089163+0000","last_change":"2024-05-09T07:54:37.090690+0000","last_active":"2024-05-09T07:54:38.089163+0000","last_peered":"2024-05-09T07:54:38.089163+0000","last_clean":"2024-05-09T07:54:38.089163+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T07:54:38.089163+0000","last_undegraded":"2024-05-09T07:54:38.089163+0000","last_fullsized":"2024-05-09T07:54:38.089163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088954+0000","last_change":"2024-05-09T07:54:37.110834+0000","last_active":"2024-05-09T07:54:38.088954+0000","last_peered":"2024-05-09T07:54:38.088954+0000","last_clean":"2024-05-09T07:54:38.088954+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T07:54:38.088954+0000","last_undegraded":"2024-05-09T07:54:38.088954+0000","last_fullsized":"2024-05-09T07:54:38.088954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090130+0000","last_change":"2024-05-09T07:54:37.099545+0000","last_active":"2024-05-09T07:54:38.090130+0000","last_peered":"2024-05-09T07:54:38.090130+0000","last_clean":"2024-05-09T07:54:38.090130+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T07:54:38.090130+0000","last_undegraded":"2024-05-09T07:54:38.090130+0000","last_fullsized":"2024-05-09T07:54:38.090130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:37.105054+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127307+0000","last_change":"2024-05-09T07:54:37.104090+0000","last_active":"2024-05-09T07:54:38.127307+0000","last_peered":"2024-05-09T07:54:38.127307+0000","last_clean":"2024-05-09T07:54:38.127307+0000","last_became_active":"2024-05-09T07:54:37.103793+0000","last_became_peered":"2024-05-09T07:54:37.103793+0000","last_unstale":"2024-05-09T07:54:38.127307+0000","last_undegraded":"2024-05-09T07:54:38.127307+0000","last_fullsized":"2024-05-09T07:54:38.127307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089303+0000","last_change":"2024-05-09T07:54:37.110846+0000","last_active":"2024-05-09T07:54:38.089303+0000","last_peered":"2024-05-09T07:54:38.089303+0000","last_clean":"2024-05-09T07:54:38.089303+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T07:54:38.089303+0000","last_undegraded":"2024-05-09T07:54:38.089303+0000","last_fullsized":"2024-05-09T07:54:38.089303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114306+0000","last_change":"2024-05-09T07:54:37.110392+0000","last_active":"2024-05-09T07:54:38.114306+0000","last_peered":"2024-05-09T07:54:38.114306+0000","last_clean":"2024-05-09T07:54:38.114306+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T07:54:38.114306+0000","last_undegraded":"2024-05-09T07:54:38.114306+0000","last_fullsized":"2024-05-09T07:54:38.114306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090055+0000","last_change":"2024-05-09T07:54:37.098797+0000","last_active":"2024-05-09T07:54:38.090055+0000","last_peered":"2024-05-09T07:54:38.090055+0000","last_clean":"2024-05-09T07:54:38.090055+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T07:54:38.090055+0000","last_undegraded":"2024-05-09T07:54:38.090055+0000","last_fullsized":"2024-05-09T07:54:38.090055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125904+0000","last_change":"2024-05-09T07:54:37.112262+0000","last_active":"2024-05-09T07:54:38.125904+0000","last_peered":"2024-05-09T07:54:38.125904+0000","last_clean":"2024-05-09T07:54:38.125904+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T07:54:38.125904+0000","last_undegraded":"2024-05-09T07:54:38.125904+0000","last_fullsized":"2024-05-09T07:54:38.125904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090032+0000","last_change":"2024-05-09T07:54:37.102723+0000","last_active":"2024-05-09T07:54:38.090032+0000","last_peered":"2024-05-09T07:54:38.090032+0000","last_clean":"2024-05-09T07:54:38.090032+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T07:54:38.090032+0000","last_undegraded":"2024-05-09T07:54:38.090032+0000","last_fullsized":"2024-05-09T07:54:38.090032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126375+0000","last_change":"2024-05-09T07:54:37.101021+0000","last_active":"2024-05-09T07:54:38.126375+0000","last_peered":"2024-05-09T07:54:38.126375+0000","last_clean":"2024-05-09T07:54:38.126375+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T07:54:38.126375+0000","last_undegraded":"2024-05-09T07:54:38.126375+0000","last_fullsized":"2024-05-09T07:54:38.126375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090192+0000","last_change":"2024-05-09T07:54:37.106515+0000","last_active":"2024-05-09T07:54:38.090192+0000","last_peered":"2024-05-09T07:54:38.090192+0000","last_clean":"2024-05-09T07:54:38.090192+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T07:54:38.090192+0000","last_undegraded":"2024-05-09T07:54:38.090192+0000","last_fullsized":"2024-05-09T07:54:38.090192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089051+0000","last_change":"2024-05-09T07:54:37.101475+0000","last_active":"2024-05-09T07:54:38.089051+0000","last_peered":"2024-05-09T07:54:38.089051+0000","last_clean":"2024-05-09T07:54:38.089051+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T07:54:38.089051+0000","last_undegraded":"2024-05-09T07:54:38.089051+0000","last_fullsized":"2024-05-09T07:54:38.089051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126288+0000","last_change":"2024-05-09T07:54:37.112908+0000","last_active":"2024-05-09T07:54:38.126288+0000","last_peered":"2024-05-09T07:54:38.126288+0000","last_clean":"2024-05-09T07:54:38.126288+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T07:54:38.126288+0000","last_undegraded":"2024-05-09T07:54:38.126288+0000","last_fullsized":"2024-05-09T07:54:38.126288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114353+0000","last_change":"2024-05-09T07:54:37.109141+0000","last_active":"2024-05-09T07:54:38.114353+0000","last_peered":"2024-05-09T07:54:38.114353+0000","last_clean":"2024-05-09T07:54:38.114353+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T07:54:38.114353+0000","last_undegraded":"2024-05-09T07:54:38.114353+0000","last_fullsized":"2024-05-09T07:54:38.114353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089775+0000","last_change":"2024-05-09T07:54:37.103105+0000","last_active":"2024-05-09T07:54:38.089775+0000","last_peered":"2024-05-09T07:54:38.089775+0000","last_clean":"2024-05-09T07:54:38.089775+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T07:54:38.089775+0000","last_undegraded":"2024-05-09T07:54:38.089775+0000","last_fullsized":"2024-05-09T07:54:38.089775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125972+0000","last_change":"2024-05-09T07:54:37.109657+0000","last_active":"2024-05-09T07:54:38.125972+0000","last_peered":"2024-05-09T07:54:38.125972+0000","last_clean":"2024-05-09T07:54:38.125972+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T07:54:38.125972+0000","last_undegraded":"2024-05-09T07:54:38.125972+0000","last_fullsized":"2024-05-09T07:54:38.125972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089035+0000","last_change":"2024-05-09T07:54:37.111278+0000","last_active":"2024-05-09T07:54:38.089035+0000","last_peered":"2024-05-09T07:54:38.089035+0000","last_clean":"2024-05-09T07:54:38.089035+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T07:54:38.089035+0000","last_undegraded":"2024-05-09T07:54:38.089035+0000","last_fullsized":"2024-05-09T07:54:38.089035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126302+0000","last_change":"2024-05-09T07:54:37.099560+0000","last_active":"2024-05-09T07:54:38.126302+0000","last_peered":"2024-05-09T07:54:38.126302+0000","last_clean":"2024-05-09T07:54:38.126302+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T07:54:38.126302+0000","last_undegraded":"2024-05-09T07:54:38.126302+0000","last_fullsized":"2024-05-09T07:54:38.126302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:30.636185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126183+0000","last_change":"2024-05-09T07:54:36.105511+0000","last_active":"2024-05-09T07:54:38.126183+0000","last_peered":"2024-05-09T07:54:38.126183+0000","last_clean":"2024-05-09T07:54:38.126183+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T07:54:38.126183+0000","last_undegraded":"2024-05-09T07:54:38.126183+0000","last_fullsized":"2024-05-09T07:54:38.126183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114445+0000","last_change":"2024-05-09T07:54:37.110626+0000","last_active":"2024-05-09T07:54:38.114445+0000","last_peered":"2024-05-09T07:54:38.114445+0000","last_clean":"2024-05-09T07:54:38.114445+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T07:54:38.114445+0000","last_undegraded":"2024-05-09T07:54:38.114445+0000","last_fullsized":"2024-05-09T07:54:38.114445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089405+0000","last_change":"2024-05-09T07:54:36.099522+0000","last_active":"2024-05-09T07:54:38.089405+0000","last_peered":"2024-05-09T07:54:38.089405+0000","last_clean":"2024-05-09T07:54:38.089405+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T07:54:38.089405+0000","last_undegraded":"2024-05-09T07:54:38.089405+0000","last_fullsized":"2024-05-09T07:54:38.089405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126052+0000","last_change":"2024-05-09T07:54:36.103352+0000","last_active":"2024-05-09T07:54:38.126052+0000","last_peered":"2024-05-09T07:54:38.126052+0000","last_clean":"2024-05-09T07:54:38.126052+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T07:54:38.126052+0000","last_undegraded":"2024-05-09T07:54:38.126052+0000","last_fullsized":"2024-05-09T07:54:38.126052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125742+0000","last_change":"2024-05-09T07:54:37.113565+0000","last_active":"2024-05-09T07:54:38.125742+0000","last_peered":"2024-05-09T07:54:38.125742+0000","last_clean":"2024-05-09T07:54:38.125742+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T07:54:38.125742+0000","last_undegraded":"2024-05-09T07:54:38.125742+0000","last_fullsized":"2024-05-09T07:54:38.125742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089786+0000","last_change":"2024-05-09T07:54:36.091893+0000","last_active":"2024-05-09T07:54:38.089786+0000","last_peered":"2024-05-09T07:54:38.089786+0000","last_clean":"2024-05-09T07:54:38.089786+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T07:54:38.089786+0000","last_undegraded":"2024-05-09T07:54:38.089786+0000","last_fullsized":"2024-05-09T07:54:38.089786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088976+0000","last_change":"2024-05-09T07:54:37.106284+0000","last_active":"2024-05-09T07:54:38.088976+0000","last_peered":"2024-05-09T07:54:38.088976+0000","last_clean":"2024-05-09T07:54:38.088976+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T07:54:38.088976+0000","last_undegraded":"2024-05-09T07:54:38.088976+0000","last_fullsized":"2024-05-09T07:54:38.088976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089802+0000","last_change":"2024-05-09T07:54:36.100068+0000","last_active":"2024-05-09T07:54:38.089802+0000","last_peered":"2024-05-09T07:54:38.089802+0000","last_clean":"2024-05-09T07:54:38.089802+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T07:54:38.089802+0000","last_undegraded":"2024-05-09T07:54:38.089802+0000","last_fullsized":"2024-05-09T07:54:38.089802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089637+0000","last_change":"2024-05-09T07:54:37.099653+0000","last_active":"2024-05-09T07:54:38.089637+0000","last_peered":"2024-05-09T07:54:38.089637+0000","last_clean":"2024-05-09T07:54:38.089637+0000","last_became_active":"2024-05-09T07:54:37.099256+0000","last_became_peered":"2024-05-09T07:54:37.099256+0000","last_unstale":"2024-05-09T07:54:38.089637+0000","last_undegraded":"2024-05-09T07:54:38.089637+0000","last_fullsized":"2024-05-09T07:54:38.089637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090072+0000","last_change":"2024-05-09T07:54:36.100368+0000","last_active":"2024-05-09T07:54:38.090072+0000","last_peered":"2024-05-09T07:54:38.090072+0000","last_clean":"2024-05-09T07:54:38.090072+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T07:54:38.090072+0000","last_undegraded":"2024-05-09T07:54:38.090072+0000","last_fullsized":"2024-05-09T07:54:38.090072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114311+0000","last_change":"2024-05-09T07:54:37.107847+0000","last_active":"2024-05-09T07:54:38.114311+0000","last_peered":"2024-05-09T07:54:38.114311+0000","last_clean":"2024-05-09T07:54:38.114311+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T07:54:38.114311+0000","last_undegraded":"2024-05-09T07:54:38.114311+0000","last_fullsized":"2024-05-09T07:54:38.114311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089184+0000","last_change":"2024-05-09T07:54:36.101694+0000","last_active":"2024-05-09T07:54:38.089184+0000","last_peered":"2024-05-09T07:54:38.089184+0000","last_clean":"2024-05-09T07:54:38.089184+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T07:54:38.089184+0000","last_undegraded":"2024-05-09T07:54:38.089184+0000","last_fullsized":"2024-05-09T07:54:38.089184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126626+0000","last_change":"2024-05-09T07:54:37.098733+0000","last_active":"2024-05-09T07:54:38.126626+0000","last_peered":"2024-05-09T07:54:38.126626+0000","last_clean":"2024-05-09T07:54:38.126626+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T07:54:38.126626+0000","last_undegraded":"2024-05-09T07:54:38.126626+0000","last_fullsized":"2024-05-09T07:54:38.126626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:15.571989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089966+0000","last_change":"2024-05-09T07:54:36.103096+0000","last_active":"2024-05-09T07:54:38.089966+0000","last_peered":"2024-05-09T07:54:38.089966+0000","last_clean":"2024-05-09T07:54:38.089966+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T07:54:38.089966+0000","last_undegraded":"2024-05-09T07:54:38.089966+0000","last_fullsized":"2024-05-09T07:54:38.089966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127096+0000","last_change":"2024-05-09T07:54:37.101875+0000","last_active":"2024-05-09T07:54:38.127096+0000","last_peered":"2024-05-09T07:54:38.127096+0000","last_clean":"2024-05-09T07:54:38.127096+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T07:54:38.127096+0000","last_undegraded":"2024-05-09T07:54:38.127096+0000","last_fullsized":"2024-05-09T07:54:38.127096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114462+0000","last_change":"2024-05-09T07:54:36.090977+0000","last_active":"2024-05-09T07:54:38.114462+0000","last_peered":"2024-05-09T07:54:38.114462+0000","last_clean":"2024-05-09T07:54:38.114462+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T07:54:38.114462+0000","last_undegraded":"2024-05-09T07:54:38.114462+0000","last_fullsized":"2024-05-09T07:54:38.114462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:17.768144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114204+0000","last_change":"2024-05-09T07:54:37.105813+0000","last_active":"2024-05-09T07:54:38.114204+0000","last_peered":"2024-05-09T07:54:38.114204+0000","last_clean":"2024-05-09T07:54:38.114204+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T07:54:38.114204+0000","last_undegraded":"2024-05-09T07:54:38.114204+0000","last_fullsized":"2024-05-09T07:54:38.114204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:02.185354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089886+0000","last_change":"2024-05-09T07:54:36.102510+0000","last_active":"2024-05-09T07:54:38.089886+0000","last_peered":"2024-05-09T07:54:38.089886+0000","last_clean":"2024-05-09T07:54:38.089886+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T07:54:38.089886+0000","last_undegraded":"2024-05-09T07:54:38.089886+0000","last_fullsized":"2024-05-09T07:54:38.089886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126997+0000","last_change":"2024-05-09T07:54:37.105015+0000","last_active":"2024-05-09T07:54:38.126997+0000","last_peered":"2024-05-09T07:54:38.126997+0000","last_clean":"2024-05-09T07:54:38.126997+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T07:54:38.126997+0000","last_undegraded":"2024-05-09T07:54:38.126997+0000","last_fullsized":"2024-05-09T07:54:38.126997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089058+0000","last_change":"2024-05-09T07:54:36.103721+0000","last_active":"2024-05-09T07:54:38.089058+0000","last_peered":"2024-05-09T07:54:38.089058+0000","last_clean":"2024-05-09T07:54:38.089058+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T07:54:38.089058+0000","last_undegraded":"2024-05-09T07:54:38.089058+0000","last_fullsized":"2024-05-09T07:54:38.089058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088980+0000","last_change":"2024-05-09T07:54:37.111215+0000","last_active":"2024-05-09T07:54:38.088980+0000","last_peered":"2024-05-09T07:54:38.088980+0000","last_clean":"2024-05-09T07:54:38.088980+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T07:54:38.088980+0000","last_undegraded":"2024-05-09T07:54:38.088980+0000","last_fullsized":"2024-05-09T07:54:38.088980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125695+0000","last_change":"2024-05-09T07:54:36.098598+0000","last_active":"2024-05-09T07:54:38.125695+0000","last_peered":"2024-05-09T07:54:38.125695+0000","last_clean":"2024-05-09T07:54:38.125695+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T07:54:38.125695+0000","last_undegraded":"2024-05-09T07:54:38.125695+0000","last_fullsized":"2024-05-09T07:54:38.125695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126550+0000","last_change":"2024-05-09T07:54:37.102764+0000","last_active":"2024-05-09T07:54:38.126550+0000","last_peered":"2024-05-09T07:54:38.126550+0000","last_clean":"2024-05-09T07:54:38.126550+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T07:54:38.126550+0000","last_undegraded":"2024-05-09T07:54:38.126550+0000","last_fullsized":"2024-05-09T07:54:38.126550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126466+0000","last_change":"2024-05-09T07:54:36.092365+0000","last_active":"2024-05-09T07:54:38.126466+0000","last_peered":"2024-05-09T07:54:38.126466+0000","last_clean":"2024-05-09T07:54:38.126466+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T07:54:38.126466+0000","last_undegraded":"2024-05-09T07:54:38.126466+0000","last_fullsized":"2024-05-09T07:54:38.126466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127009+0000","last_change":"2024-05-09T07:54:37.100214+0000","last_active":"2024-05-09T07:54:38.127009+0000","last_peered":"2024-05-09T07:54:38.127009+0000","last_clean":"2024-05-09T07:54:38.127009+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T07:54:38.127009+0000","last_undegraded":"2024-05-09T07:54:38.127009+0000","last_fullsized":"2024-05-09T07:54:38.127009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126065+0000","last_change":"2024-05-09T07:54:36.100004+0000","last_active":"2024-05-09T07:54:38.126065+0000","last_peered":"2024-05-09T07:54:38.126065+0000","last_clean":"2024-05-09T07:54:38.126065+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T07:54:38.126065+0000","last_undegraded":"2024-05-09T07:54:38.126065+0000","last_fullsized":"2024-05-09T07:54:38.126065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127108+0000","last_change":"2024-05-09T07:54:37.100879+0000","last_active":"2024-05-09T07:54:38.127108+0000","last_peered":"2024-05-09T07:54:38.127108+0000","last_clean":"2024-05-09T07:54:38.127108+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T07:54:38.127108+0000","last_undegraded":"2024-05-09T07:54:38.127108+0000","last_fullsized":"2024-05-09T07:54:38.127108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089145+0000","last_change":"2024-05-09T07:54:36.099594+0000","last_active":"2024-05-09T07:54:38.089145+0000","last_peered":"2024-05-09T07:54:38.089145+0000","last_clean":"2024-05-09T07:54:38.089145+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T07:54:38.089145+0000","last_undegraded":"2024-05-09T07:54:38.089145+0000","last_fullsized":"2024-05-09T07:54:38.089145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090354+0000","last_change":"2024-05-09T07:54:37.103885+0000","last_active":"2024-05-09T07:54:38.090354+0000","last_peered":"2024-05-09T07:54:38.090354+0000","last_clean":"2024-05-09T07:54:38.090354+0000","last_became_active":"2024-05-09T07:54:37.103150+0000","last_became_peered":"2024-05-09T07:54:37.103150+0000","last_unstale":"2024-05-09T07:54:38.090354+0000","last_undegraded":"2024-05-09T07:54:38.090354+0000","last_fullsized":"2024-05-09T07:54:38.090354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125835+0000","last_change":"2024-05-09T07:54:36.097398+0000","last_active":"2024-05-09T07:54:38.125835+0000","last_peered":"2024-05-09T07:54:38.125835+0000","last_clean":"2024-05-09T07:54:38.125835+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T07:54:38.125835+0000","last_undegraded":"2024-05-09T07:54:38.125835+0000","last_fullsized":"2024-05-09T07:54:38.125835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127276+0000","last_change":"2024-05-09T07:54:37.108574+0000","last_active":"2024-05-09T07:54:38.127276+0000","last_peered":"2024-05-09T07:54:38.127276+0000","last_clean":"2024-05-09T07:54:38.127276+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T07:54:38.127276+0000","last_undegraded":"2024-05-09T07:54:38.127276+0000","last_fullsized":"2024-05-09T07:54:38.127276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089307+0000","last_change":"2024-05-09T07:54:36.097635+0000","last_active":"2024-05-09T07:54:38.089307+0000","last_peered":"2024-05-09T07:54:38.089307+0000","last_clean":"2024-05-09T07:54:38.089307+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T07:54:38.089307+0000","last_undegraded":"2024-05-09T07:54:38.089307+0000","last_fullsized":"2024-05-09T07:54:38.089307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125983+0000","last_change":"2024-05-09T07:54:37.111470+0000","last_active":"2024-05-09T07:54:38.125983+0000","last_peered":"2024-05-09T07:54:38.125983+0000","last_clean":"2024-05-09T07:54:38.125983+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T07:54:38.125983+0000","last_undegraded":"2024-05-09T07:54:38.125983+0000","last_fullsized":"2024-05-09T07:54:38.125983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126209+0000","last_change":"2024-05-09T07:54:36.107162+0000","last_active":"2024-05-09T07:54:38.126209+0000","last_peered":"2024-05-09T07:54:38.126209+0000","last_clean":"2024-05-09T07:54:38.126209+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T07:54:38.126209+0000","last_undegraded":"2024-05-09T07:54:38.126209+0000","last_fullsized":"2024-05-09T07:54:38.126209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114106+0000","last_change":"2024-05-09T07:54:37.102062+0000","last_active":"2024-05-09T07:54:38.114106+0000","last_peered":"2024-05-09T07:54:38.114106+0000","last_clean":"2024-05-09T07:54:38.114106+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T07:54:38.114106+0000","last_undegraded":"2024-05-09T07:54:38.114106+0000","last_fullsized":"2024-05-09T07:54:38.114106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:32.555846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125875+0000","last_change":"2024-05-09T07:54:36.100227+0000","last_active":"2024-05-09T07:54:38.125875+0000","last_peered":"2024-05-09T07:54:38.125875+0000","last_clean":"2024-05-09T07:54:38.125875+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T07:54:38.125875+0000","last_undegraded":"2024-05-09T07:54:38.125875+0000","last_fullsized":"2024-05-09T07:54:38.125875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089178+0000","last_change":"2024-05-09T07:54:37.109167+0000","last_active":"2024-05-09T07:54:38.089178+0000","last_peered":"2024-05-09T07:54:38.089178+0000","last_clean":"2024-05-09T07:54:38.089178+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T07:54:38.089178+0000","last_undegraded":"2024-05-09T07:54:38.089178+0000","last_fullsized":"2024-05-09T07:54:38.089178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090002+0000","last_change":"2024-05-09T07:54:36.100426+0000","last_active":"2024-05-09T07:54:38.090002+0000","last_peered":"2024-05-09T07:54:38.090002+0000","last_clean":"2024-05-09T07:54:38.090002+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T07:54:38.090002+0000","last_undegraded":"2024-05-09T07:54:38.090002+0000","last_fullsized":"2024-05-09T07:54:38.090002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126610+0000","last_change":"2024-05-09T07:54:37.108794+0000","last_active":"2024-05-09T07:54:38.126610+0000","last_peered":"2024-05-09T07:54:38.126610+0000","last_clean":"2024-05-09T07:54:38.126610+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T07:54:38.126610+0000","last_undegraded":"2024-05-09T07:54:38.126610+0000","last_fullsized":"2024-05-09T07:54:38.126610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:43.498827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089162+0000","last_change":"2024-05-09T07:54:36.104155+0000","last_active":"2024-05-09T07:54:38.089162+0000","last_peered":"2024-05-09T07:54:38.089162+0000","last_clean":"2024-05-09T07:54:38.089162+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T07:54:38.089162+0000","last_undegraded":"2024-05-09T07:54:38.089162+0000","last_fullsized":"2024-05-09T07:54:38.089162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090218+0000","last_change":"2024-05-09T07:54:37.103562+0000","last_active":"2024-05-09T07:54:38.090218+0000","last_peered":"2024-05-09T07:54:38.090218+0000","last_clean":"2024-05-09T07:54:38.090218+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T07:54:38.090218+0000","last_undegraded":"2024-05-09T07:54:38.090218+0000","last_fullsized":"2024-05-09T07:54:38.090218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127376+0000","last_change":"2024-05-09T07:54:36.106399+0000","last_active":"2024-05-09T07:54:38.127376+0000","last_peered":"2024-05-09T07:54:38.127376+0000","last_clean":"2024-05-09T07:54:38.127376+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T07:54:38.127376+0000","last_undegraded":"2024-05-09T07:54:38.127376+0000","last_fullsized":"2024-05-09T07:54:38.127376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089072+0000","last_change":"2024-05-09T07:54:37.105988+0000","last_active":"2024-05-09T07:54:38.089072+0000","last_peered":"2024-05-09T07:54:38.089072+0000","last_clean":"2024-05-09T07:54:38.089072+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T07:54:38.089072+0000","last_undegraded":"2024-05-09T07:54:38.089072+0000","last_fullsized":"2024-05-09T07:54:38.089072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.102035+0000","last_change":"2024-05-09T07:54:36.101002+0000","last_active":"2024-05-09T07:54:38.102035+0000","last_peered":"2024-05-09T07:54:38.102035+0000","last_clean":"2024-05-09T07:54:38.102035+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T07:54:38.102035+0000","last_undegraded":"2024-05-09T07:54:38.102035+0000","last_fullsized":"2024-05-09T07:54:38.102035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126405+0000","last_change":"2024-05-09T07:54:37.100183+0000","last_active":"2024-05-09T07:54:38.126405+0000","last_peered":"2024-05-09T07:54:38.126405+0000","last_clean":"2024-05-09T07:54:38.126405+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T07:54:38.126405+0000","last_undegraded":"2024-05-09T07:54:38.126405+0000","last_fullsized":"2024-05-09T07:54:38.126405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089901+0000","last_change":"2024-05-09T07:54:36.105813+0000","last_active":"2024-05-09T07:54:38.089901+0000","last_peered":"2024-05-09T07:54:38.089901+0000","last_clean":"2024-05-09T07:54:38.089901+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T07:54:38.089901+0000","last_undegraded":"2024-05-09T07:54:38.089901+0000","last_fullsized":"2024-05-09T07:54:38.089901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114359+0000","last_change":"2024-05-09T07:54:37.107782+0000","last_active":"2024-05-09T07:54:38.114359+0000","last_peered":"2024-05-09T07:54:38.114359+0000","last_clean":"2024-05-09T07:54:38.114359+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T07:54:38.114359+0000","last_undegraded":"2024-05-09T07:54:38.114359+0000","last_fullsized":"2024-05-09T07:54:38.114359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125962+0000","last_change":"2024-05-09T07:54:36.106409+0000","last_active":"2024-05-09T07:54:38.125962+0000","last_peered":"2024-05-09T07:54:38.125962+0000","last_clean":"2024-05-09T07:54:38.125962+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T07:54:38.125962+0000","last_undegraded":"2024-05-09T07:54:38.125962+0000","last_fullsized":"2024-05-09T07:54:38.125962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126537+0000","last_change":"2024-05-09T07:54:37.104920+0000","last_active":"2024-05-09T07:54:38.126537+0000","last_peered":"2024-05-09T07:54:38.126537+0000","last_clean":"2024-05-09T07:54:38.126537+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T07:54:38.126537+0000","last_undegraded":"2024-05-09T07:54:38.126537+0000","last_fullsized":"2024-05-09T07:54:38.126537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089089+0000","last_change":"2024-05-09T07:54:36.105662+0000","last_active":"2024-05-09T07:54:38.089089+0000","last_peered":"2024-05-09T07:54:38.089089+0000","last_clean":"2024-05-09T07:54:38.089089+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T07:54:38.089089+0000","last_undegraded":"2024-05-09T07:54:38.089089+0000","last_fullsized":"2024-05-09T07:54:38.089089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125906+0000","last_change":"2024-05-09T07:54:37.103640+0000","last_active":"2024-05-09T07:54:38.125906+0000","last_peered":"2024-05-09T07:54:38.125906+0000","last_clean":"2024-05-09T07:54:38.125906+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T07:54:38.125906+0000","last_undegraded":"2024-05-09T07:54:38.125906+0000","last_fullsized":"2024-05-09T07:54:38.125906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089139+0000","last_change":"2024-05-09T07:54:36.102636+0000","last_active":"2024-05-09T07:54:38.089139+0000","last_peered":"2024-05-09T07:54:38.089139+0000","last_clean":"2024-05-09T07:54:38.089139+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T07:54:38.089139+0000","last_undegraded":"2024-05-09T07:54:38.089139+0000","last_fullsized":"2024-05-09T07:54:38.089139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126076+0000","last_change":"2024-05-09T07:54:37.113734+0000","last_active":"2024-05-09T07:54:38.126076+0000","last_peered":"2024-05-09T07:54:38.126076+0000","last_clean":"2024-05-09T07:54:38.126076+0000","last_became_active":"2024-05-09T07:54:37.113448+0000","last_became_peered":"2024-05-09T07:54:37.113448+0000","last_unstale":"2024-05-09T07:54:38.126076+0000","last_undegraded":"2024-05-09T07:54:38.126076+0000","last_fullsized":"2024-05-09T07:54:38.126076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127166+0000","last_change":"2024-05-09T07:54:36.104367+0000","last_active":"2024-05-09T07:54:38.127166+0000","last_peered":"2024-05-09T07:54:38.127166+0000","last_clean":"2024-05-09T07:54:38.127166+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T07:54:38.127166+0000","last_undegraded":"2024-05-09T07:54:38.127166+0000","last_fullsized":"2024-05-09T07:54:38.127166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088985+0000","last_change":"2024-05-09T07:54:37.111038+0000","last_active":"2024-05-09T07:54:38.088985+0000","last_peered":"2024-05-09T07:54:38.088985+0000","last_clean":"2024-05-09T07:54:38.088985+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T07:54:38.088985+0000","last_undegraded":"2024-05-09T07:54:38.088985+0000","last_fullsized":"2024-05-09T07:54:38.088985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089727+0000","last_change":"2024-05-09T07:54:37.091699+0000","last_active":"2024-05-09T07:54:38.089727+0000","last_peered":"2024-05-09T07:54:38.089727+0000","last_clean":"2024-05-09T07:54:38.089727+0000","last_became_active":"2024-05-09T07:54:37.091280+0000","last_became_peered":"2024-05-09T07:54:37.091280+0000","last_unstale":"2024-05-09T07:54:38.089727+0000","last_undegraded":"2024-05-09T07:54:38.089727+0000","last_fullsized":"2024-05-09T07:54:38.089727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127058+0000","last_change":"2024-05-09T07:54:36.105726+0000","last_active":"2024-05-09T07:54:38.127058+0000","last_peered":"2024-05-09T07:54:38.127058+0000","last_clean":"2024-05-09T07:54:38.127058+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T07:54:38.127058+0000","last_undegraded":"2024-05-09T07:54:38.127058+0000","last_fullsized":"2024-05-09T07:54:38.127058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090261+0000","last_change":"2024-05-09T07:54:37.092061+0000","last_active":"2024-05-09T07:54:38.090261+0000","last_peered":"2024-05-09T07:54:38.090261+0000","last_clean":"2024-05-09T07:54:38.090261+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T07:54:38.090261+0000","last_undegraded":"2024-05-09T07:54:38.090261+0000","last_fullsized":"2024-05-09T07:54:38.090261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127214+0000","last_change":"2024-05-09T07:54:36.106635+0000","last_active":"2024-05-09T07:54:38.127214+0000","last_peered":"2024-05-09T07:54:38.127214+0000","last_clean":"2024-05-09T07:54:38.127214+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T07:54:38.127214+0000","last_undegraded":"2024-05-09T07:54:38.127214+0000","last_fullsized":"2024-05-09T07:54:38.127214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114272+0000","last_change":"2024-05-09T07:54:37.108470+0000","last_active":"2024-05-09T07:54:38.114272+0000","last_peered":"2024-05-09T07:54:38.114272+0000","last_clean":"2024-05-09T07:54:38.114272+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T07:54:38.114272+0000","last_undegraded":"2024-05-09T07:54:38.114272+0000","last_fullsized":"2024-05-09T07:54:38.114272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126415+0000","last_change":"2024-05-09T07:54:36.102502+0000","last_active":"2024-05-09T07:54:38.126415+0000","last_peered":"2024-05-09T07:54:38.126415+0000","last_clean":"2024-05-09T07:54:38.126415+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T07:54:38.126415+0000","last_undegraded":"2024-05-09T07:54:38.126415+0000","last_fullsized":"2024-05-09T07:54:38.126415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126360+0000","last_change":"2024-05-09T07:54:37.104598+0000","last_active":"2024-05-09T07:54:38.126360+0000","last_peered":"2024-05-09T07:54:38.126360+0000","last_clean":"2024-05-09T07:54:38.126360+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T07:54:38.126360+0000","last_undegraded":"2024-05-09T07:54:38.126360+0000","last_fullsized":"2024-05-09T07:54:38.126360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114410+0000","last_change":"2024-05-09T07:54:36.101744+0000","last_active":"2024-05-09T07:54:38.114410+0000","last_peered":"2024-05-09T07:54:38.114410+0000","last_clean":"2024-05-09T07:54:38.114410+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T07:54:38.114410+0000","last_undegraded":"2024-05-09T07:54:38.114410+0000","last_fullsized":"2024-05-09T07:54:38.114410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":798720,"data_stored":659695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":76657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":70357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T07:54:44.828 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T07:54:44.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.926+0000 7fe61cbb7640 1 Processor -- start 2024-05-09T07:54:44.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.926+0000 7fe61cbb7640 1 -- start start 2024-05-09T07:54:44.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.926+0000 7fe61cbb7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe6180b2a50 0x7fe618145e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:44.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61cbb7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe618146360 0x7fe61814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:44.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61cbb7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6180b3ad0 con 0x7fe61806fbf0 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61cbb7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe618071340 con 0x7fe6180b2a50 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61cbb7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe618145640 con 0x7fe618146360 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61659c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe6180b2a50 0x7fe618145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61659c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe6180b2a50 0x7fe618145e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55452/0 (socket says 172.21.15.87:55452) 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe615d9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe61806fbf0 0x7fe618072b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43554/0 (socket says 172.21.15.87:43554) 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61659c640 1 -- 172.21.15.87:0/2663841795 learned_addr learned my addr 172.21.15.87:0/2663841795 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe616d9d640 1 --2- 172.21.15.87:0/2663841795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe618146360 0x7fe61814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61659c640 1 -- 172.21.15.87:0/2663841795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe618146360 msgr2=0x7fe61814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61659c640 1 --2- 172.21.15.87:0/2663841795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe618146360 0x7fe61814fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61659c640 1 -- 172.21.15.87:0/2663841795 >> v1:172.21.15.87:6789/0 conn(0x7fe61806fbf0 legacy=0x7fe618072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61659c640 1 -- 172.21.15.87:0/2663841795 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6180700a0 con 0x7fe6180b2a50 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.927+0000 7fe61559a640 1 -- 172.21.15.87:0/2663841795 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056099101 0 0) 0x7fe6180b3ad0 con 0x7fe61806fbf0 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61659c640 1 --2- 172.21.15.87:0/2663841795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6180b2a50 0x7fe618145e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e50 tx=0x7fe60802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4697e0151f92d414 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61559a640 1 -- 172.21.15.87:0/2663841795 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608036070 con 0x7fe6180b2a50 2024-05-09T07:54:44.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61559a640 1 -- 172.21.15.87:0/2663841795 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe608031600 con 0x7fe6180b2a50 2024-05-09T07:54:44.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61559a640 1 -- 172.21.15.87:0/2663841795 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6080319d0 con 0x7fe6180b2a50 2024-05-09T07:54:44.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61cbb7640 1 -- 172.21.15.87:0/2663841795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6180b2a50 msgr2=0x7fe618145e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:44.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61cbb7640 1 --2- 172.21.15.87:0/2663841795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6180b2a50 0x7fe618145e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e50 tx=0x7fe60802a5f0 comp rx=0 tx=0).stop 2024-05-09T07:54:44.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61cbb7640 1 -- 172.21.15.87:0/2663841795 shutdown_connections 2024-05-09T07:54:44.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61cbb7640 1 --2- 172.21.15.87:0/2663841795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe618146360 0x7fe61814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:44.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61cbb7640 1 --2- 172.21.15.87:0/2663841795 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe6180b2a50 0x7fe618145e20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:44.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.928+0000 7fe61cbb7640 1 -- 172.21.15.87:0/2663841795 >> 172.21.15.87:0/2663841795 conn(0x7fe6180b90d0 msgr2=0x7fe6180b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:44.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.929+0000 7fe61cbb7640 1 -- 172.21.15.87:0/2663841795 shutdown_connections 2024-05-09T07:54:44.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.929+0000 7fe61cbb7640 1 -- 172.21.15.87:0/2663841795 wait complete. 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61cbb7640 1 Processor -- start 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61cbb7640 1 -- start start 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61cbb7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe61806fbf0 0x7fe6181cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61cbb7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6180b2a50 0x7fe6181ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61cbb7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe618146360 0x7fe6181cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61cbb7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe6180b58d0 con 0x7fe61806fbf0 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61cbb7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe6180b2e30 con 0x7fe618146360 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61cbb7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe61806f7c0 con 0x7fe6180b2a50 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe61806fbf0 0x7fe6181cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61659c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe61806fbf0 0x7fe6181cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55462/0 (socket says 172.21.15.87:55462) 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.930+0000 7fe61659c640 1 -- 172.21.15.87:0/545329252 learned_addr learned my addr 172.21.15.87:0/545329252 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe615d9b640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6180b2a50 0x7fe6181ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:44.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe616d9d640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe618146360 0x7fe6181cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe61659c640 1 -- 172.21.15.87:0/545329252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6180b2a50 msgr2=0x7fe6181ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe61659c640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6180b2a50 0x7fe6181ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe61659c640 1 -- 172.21.15.87:0/545329252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe618146360 msgr2=0x7fe6181cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe61659c640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe618146360 0x7fe6181cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe61659c640 1 -- 172.21.15.87:0/545329252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6181ce1a0 con 0x7fe61806fbf0 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe615d9b640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6180b2a50 0x7fe6181ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe61659c640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe61806fbf0 0x7fe6181cdb00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e50 tx=0x7fe608004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe606ffd640 1 -- 172.21.15.87:0/545329252 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608036050 con 0x7fe61806fbf0 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe606ffd640 1 -- 172.21.15.87:0/545329252 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe608042070 con 0x7fe61806fbf0 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6181cf030 con 0x7fe61806fbf0 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe606ffd640 1 -- 172.21.15.87:0/545329252 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608007c70 con 0x7fe61806fbf0 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.931+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6181cd000 con 0x7fe61806fbf0 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.932+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6180691f0 con 0x7fe61806fbf0 2024-05-09T07:54:44.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.933+0000 7fe606ffd640 1 -- 172.21.15.87:0/545329252 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe608047460 con 0x7fe61806fbf0 2024-05-09T07:54:44.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.933+0000 7fe606ffd640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe5f806be30 0x7fe5f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:44.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.933+0000 7fe606ffd640 1 -- 172.21.15.87:0/545329252 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe6080abd80 con 0x7fe61806fbf0 2024-05-09T07:54:44.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.933+0000 7fe615d9b640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe5f806be30 0x7fe5f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:44.950 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.934+0000 7fe615d9b640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe5f806be30 0x7fe5f806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe6180b51b0 tx=0x7fe60c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:44.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:44.938+0000 7fe606ffd640 1 -- 172.21.15.87:0/545329252 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe60807a7c0 con 0x7fe61806fbf0 2024-05-09T07:54:45.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.108+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6181cee80 con 0x7fe5f806be30 2024-05-09T07:54:45.129 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.114+0000 7fe606ffd640 1 -- 172.21.15.87:0/545329252 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251872 (secure 0 0 0) 0x7fe6181cee80 con 0x7fe5f806be30 2024-05-09T07:54:45.132 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:45.133 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe5f806be30 msgr2=0x7fe5f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe5f806be30 0x7fe5f806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe6180b51b0 tx=0x7fe60c009040 comp rx=0 tx=0).stop 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe61806fbf0 msgr2=0x7fe6181cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe61806fbf0 0x7fe6181cdb00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e50 tx=0x7fe608004a40 comp rx=0 tx=0).stop 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 shutdown_connections 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe5f806be30 0x7fe5f806e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6180b2a50 0x7fe6181ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe618146360 0x7fe6181cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 --2- 172.21.15.87:0/545329252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe61806fbf0 0x7fe6181cdb00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 >> 172.21.15.87:0/545329252 conn(0x7fe6180b90d0 msgr2=0x7fe6180b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 shutdown_connections 2024-05-09T07:54:45.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.117+0000 7fe61cbb7640 1 -- 172.21.15.87:0/545329252 wait complete. 2024-05-09T07:54:45.143 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-05-09T07:54:44.893111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235696,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739024,"statfs":{"total":773094113280,"available":772852760576,"internally_reserved":0,"allocated":2957312,"data_stored":1785916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001626"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126816+0000","last_change":"2024-05-09T07:54:37.107065+0000","last_active":"2024-05-09T07:54:38.126816+0000","last_peered":"2024-05-09T07:54:38.126816+0000","last_clean":"2024-05-09T07:54:38.126816+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T07:54:38.126816+0000","last_undegraded":"2024-05-09T07:54:38.126816+0000","last_fullsized":"2024-05-09T07:54:38.126816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089122+0000","last_change":"2024-05-09T07:54:37.109460+0000","last_active":"2024-05-09T07:54:38.089122+0000","last_peered":"2024-05-09T07:54:38.089122+0000","last_clean":"2024-05-09T07:54:38.089122+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T07:54:38.089122+0000","last_undegraded":"2024-05-09T07:54:38.089122+0000","last_fullsized":"2024-05-09T07:54:38.089122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114255+0000","last_change":"2024-05-09T07:54:37.108923+0000","last_active":"2024-05-09T07:54:38.114255+0000","last_peered":"2024-05-09T07:54:38.114255+0000","last_clean":"2024-05-09T07:54:38.114255+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T07:54:38.114255+0000","last_undegraded":"2024-05-09T07:54:38.114255+0000","last_fullsized":"2024-05-09T07:54:38.114255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090307+0000","last_change":"2024-05-09T07:54:37.104600+0000","last_active":"2024-05-09T07:54:38.090307+0000","last_peered":"2024-05-09T07:54:38.090307+0000","last_clean":"2024-05-09T07:54:38.090307+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T07:54:38.090307+0000","last_undegraded":"2024-05-09T07:54:38.090307+0000","last_fullsized":"2024-05-09T07:54:38.090307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126911+0000","last_change":"2024-05-09T07:54:37.104101+0000","last_active":"2024-05-09T07:54:38.126911+0000","last_peered":"2024-05-09T07:54:38.126911+0000","last_clean":"2024-05-09T07:54:38.126911+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T07:54:38.126911+0000","last_undegraded":"2024-05-09T07:54:38.126911+0000","last_fullsized":"2024-05-09T07:54:38.126911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089353+0000","last_change":"2024-05-09T07:54:37.109462+0000","last_active":"2024-05-09T07:54:38.089353+0000","last_peered":"2024-05-09T07:54:38.089353+0000","last_clean":"2024-05-09T07:54:38.089353+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T07:54:38.089353+0000","last_undegraded":"2024-05-09T07:54:38.089353+0000","last_fullsized":"2024-05-09T07:54:38.089353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126521+0000","last_change":"2024-05-09T07:54:37.114222+0000","last_active":"2024-05-09T07:54:38.126521+0000","last_peered":"2024-05-09T07:54:38.126521+0000","last_clean":"2024-05-09T07:54:38.126521+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T07:54:38.126521+0000","last_undegraded":"2024-05-09T07:54:38.126521+0000","last_fullsized":"2024-05-09T07:54:38.126521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125744+0000","last_change":"2024-05-09T07:54:37.110852+0000","last_active":"2024-05-09T07:54:38.125744+0000","last_peered":"2024-05-09T07:54:38.125744+0000","last_clean":"2024-05-09T07:54:38.125744+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T07:54:38.125744+0000","last_undegraded":"2024-05-09T07:54:38.125744+0000","last_fullsized":"2024-05-09T07:54:38.125744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126973+0000","last_change":"2024-05-09T07:54:37.106997+0000","last_active":"2024-05-09T07:54:38.126973+0000","last_peered":"2024-05-09T07:54:38.126973+0000","last_clean":"2024-05-09T07:54:38.126973+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T07:54:38.126973+0000","last_undegraded":"2024-05-09T07:54:38.126973+0000","last_fullsized":"2024-05-09T07:54:38.126973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090143+0000","last_change":"2024-05-09T07:54:37.112111+0000","last_active":"2024-05-09T07:54:38.090143+0000","last_peered":"2024-05-09T07:54:38.090143+0000","last_clean":"2024-05-09T07:54:38.090143+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T07:54:38.090143+0000","last_undegraded":"2024-05-09T07:54:38.090143+0000","last_fullsized":"2024-05-09T07:54:38.090143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089595+0000","last_change":"2024-05-09T07:54:37.111412+0000","last_active":"2024-05-09T07:54:38.089595+0000","last_peered":"2024-05-09T07:54:38.089595+0000","last_clean":"2024-05-09T07:54:38.089595+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T07:54:38.089595+0000","last_undegraded":"2024-05-09T07:54:38.089595+0000","last_fullsized":"2024-05-09T07:54:38.089595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126529+0000","last_change":"2024-05-09T07:54:37.103229+0000","last_active":"2024-05-09T07:54:38.126529+0000","last_peered":"2024-05-09T07:54:38.126529+0000","last_clean":"2024-05-09T07:54:38.126529+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T07:54:38.126529+0000","last_undegraded":"2024-05-09T07:54:38.126529+0000","last_fullsized":"2024-05-09T07:54:38.126529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125825+0000","last_change":"2024-05-09T07:54:37.104238+0000","last_active":"2024-05-09T07:54:38.125825+0000","last_peered":"2024-05-09T07:54:38.125825+0000","last_clean":"2024-05-09T07:54:38.125825+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T07:54:38.125825+0000","last_undegraded":"2024-05-09T07:54:38.125825+0000","last_fullsized":"2024-05-09T07:54:38.125825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114110+0000","last_change":"2024-05-09T07:54:37.105958+0000","last_active":"2024-05-09T07:54:38.114110+0000","last_peered":"2024-05-09T07:54:38.114110+0000","last_clean":"2024-05-09T07:54:38.114110+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T07:54:38.114110+0000","last_undegraded":"2024-05-09T07:54:38.114110+0000","last_fullsized":"2024-05-09T07:54:38.114110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:38.316625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089163+0000","last_change":"2024-05-09T07:54:37.090690+0000","last_active":"2024-05-09T07:54:38.089163+0000","last_peered":"2024-05-09T07:54:38.089163+0000","last_clean":"2024-05-09T07:54:38.089163+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T07:54:38.089163+0000","last_undegraded":"2024-05-09T07:54:38.089163+0000","last_fullsized":"2024-05-09T07:54:38.089163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088954+0000","last_change":"2024-05-09T07:54:37.110834+0000","last_active":"2024-05-09T07:54:38.088954+0000","last_peered":"2024-05-09T07:54:38.088954+0000","last_clean":"2024-05-09T07:54:38.088954+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T07:54:38.088954+0000","last_undegraded":"2024-05-09T07:54:38.088954+0000","last_fullsized":"2024-05-09T07:54:38.088954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090130+0000","last_change":"2024-05-09T07:54:37.099545+0000","last_active":"2024-05-09T07:54:38.090130+0000","last_peered":"2024-05-09T07:54:38.090130+0000","last_clean":"2024-05-09T07:54:38.090130+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T07:54:38.090130+0000","last_undegraded":"2024-05-09T07:54:38.090130+0000","last_fullsized":"2024-05-09T07:54:38.090130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:37.105054+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127307+0000","last_change":"2024-05-09T07:54:37.104090+0000","last_active":"2024-05-09T07:54:38.127307+0000","last_peered":"2024-05-09T07:54:38.127307+0000","last_clean":"2024-05-09T07:54:38.127307+0000","last_became_active":"2024-05-09T07:54:37.103793+0000","last_became_peered":"2024-05-09T07:54:37.103793+0000","last_unstale":"2024-05-09T07:54:38.127307+0000","last_undegraded":"2024-05-09T07:54:38.127307+0000","last_fullsized":"2024-05-09T07:54:38.127307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089303+0000","last_change":"2024-05-09T07:54:37.110846+0000","last_active":"2024-05-09T07:54:38.089303+0000","last_peered":"2024-05-09T07:54:38.089303+0000","last_clean":"2024-05-09T07:54:38.089303+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T07:54:38.089303+0000","last_undegraded":"2024-05-09T07:54:38.089303+0000","last_fullsized":"2024-05-09T07:54:38.089303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114306+0000","last_change":"2024-05-09T07:54:37.110392+0000","last_active":"2024-05-09T07:54:38.114306+0000","last_peered":"2024-05-09T07:54:38.114306+0000","last_clean":"2024-05-09T07:54:38.114306+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T07:54:38.114306+0000","last_undegraded":"2024-05-09T07:54:38.114306+0000","last_fullsized":"2024-05-09T07:54:38.114306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090055+0000","last_change":"2024-05-09T07:54:37.098797+0000","last_active":"2024-05-09T07:54:38.090055+0000","last_peered":"2024-05-09T07:54:38.090055+0000","last_clean":"2024-05-09T07:54:38.090055+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T07:54:38.090055+0000","last_undegraded":"2024-05-09T07:54:38.090055+0000","last_fullsized":"2024-05-09T07:54:38.090055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125904+0000","last_change":"2024-05-09T07:54:37.112262+0000","last_active":"2024-05-09T07:54:38.125904+0000","last_peered":"2024-05-09T07:54:38.125904+0000","last_clean":"2024-05-09T07:54:38.125904+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T07:54:38.125904+0000","last_undegraded":"2024-05-09T07:54:38.125904+0000","last_fullsized":"2024-05-09T07:54:38.125904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090032+0000","last_change":"2024-05-09T07:54:37.102723+0000","last_active":"2024-05-09T07:54:38.090032+0000","last_peered":"2024-05-09T07:54:38.090032+0000","last_clean":"2024-05-09T07:54:38.090032+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T07:54:38.090032+0000","last_undegraded":"2024-05-09T07:54:38.090032+0000","last_fullsized":"2024-05-09T07:54:38.090032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126375+0000","last_change":"2024-05-09T07:54:37.101021+0000","last_active":"2024-05-09T07:54:38.126375+0000","last_peered":"2024-05-09T07:54:38.126375+0000","last_clean":"2024-05-09T07:54:38.126375+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T07:54:38.126375+0000","last_undegraded":"2024-05-09T07:54:38.126375+0000","last_fullsized":"2024-05-09T07:54:38.126375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090192+0000","last_change":"2024-05-09T07:54:37.106515+0000","last_active":"2024-05-09T07:54:38.090192+0000","last_peered":"2024-05-09T07:54:38.090192+0000","last_clean":"2024-05-09T07:54:38.090192+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T07:54:38.090192+0000","last_undegraded":"2024-05-09T07:54:38.090192+0000","last_fullsized":"2024-05-09T07:54:38.090192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089051+0000","last_change":"2024-05-09T07:54:37.101475+0000","last_active":"2024-05-09T07:54:38.089051+0000","last_peered":"2024-05-09T07:54:38.089051+0000","last_clean":"2024-05-09T07:54:38.089051+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T07:54:38.089051+0000","last_undegraded":"2024-05-09T07:54:38.089051+0000","last_fullsized":"2024-05-09T07:54:38.089051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126288+0000","last_change":"2024-05-09T07:54:37.112908+0000","last_active":"2024-05-09T07:54:38.126288+0000","last_peered":"2024-05-09T07:54:38.126288+0000","last_clean":"2024-05-09T07:54:38.126288+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T07:54:38.126288+0000","last_undegraded":"2024-05-09T07:54:38.126288+0000","last_fullsized":"2024-05-09T07:54:38.126288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114353+0000","last_change":"2024-05-09T07:54:37.109141+0000","last_active":"2024-05-09T07:54:38.114353+0000","last_peered":"2024-05-09T07:54:38.114353+0000","last_clean":"2024-05-09T07:54:38.114353+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T07:54:38.114353+0000","last_undegraded":"2024-05-09T07:54:38.114353+0000","last_fullsized":"2024-05-09T07:54:38.114353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089775+0000","last_change":"2024-05-09T07:54:37.103105+0000","last_active":"2024-05-09T07:54:38.089775+0000","last_peered":"2024-05-09T07:54:38.089775+0000","last_clean":"2024-05-09T07:54:38.089775+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T07:54:38.089775+0000","last_undegraded":"2024-05-09T07:54:38.089775+0000","last_fullsized":"2024-05-09T07:54:38.089775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125972+0000","last_change":"2024-05-09T07:54:37.109657+0000","last_active":"2024-05-09T07:54:38.125972+0000","last_peered":"2024-05-09T07:54:38.125972+0000","last_clean":"2024-05-09T07:54:38.125972+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T07:54:38.125972+0000","last_undegraded":"2024-05-09T07:54:38.125972+0000","last_fullsized":"2024-05-09T07:54:38.125972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089035+0000","last_change":"2024-05-09T07:54:37.111278+0000","last_active":"2024-05-09T07:54:38.089035+0000","last_peered":"2024-05-09T07:54:38.089035+0000","last_clean":"2024-05-09T07:54:38.089035+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T07:54:38.089035+0000","last_undegraded":"2024-05-09T07:54:38.089035+0000","last_fullsized":"2024-05-09T07:54:38.089035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126302+0000","last_change":"2024-05-09T07:54:37.099560+0000","last_active":"2024-05-09T07:54:38.126302+0000","last_peered":"2024-05-09T07:54:38.126302+0000","last_clean":"2024-05-09T07:54:38.126302+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T07:54:38.126302+0000","last_undegraded":"2024-05-09T07:54:38.126302+0000","last_fullsized":"2024-05-09T07:54:38.126302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:30.636185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126183+0000","last_change":"2024-05-09T07:54:36.105511+0000","last_active":"2024-05-09T07:54:38.126183+0000","last_peered":"2024-05-09T07:54:38.126183+0000","last_clean":"2024-05-09T07:54:38.126183+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T07:54:38.126183+0000","last_undegraded":"2024-05-09T07:54:38.126183+0000","last_fullsized":"2024-05-09T07:54:38.126183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114445+0000","last_change":"2024-05-09T07:54:37.110626+0000","last_active":"2024-05-09T07:54:38.114445+0000","last_peered":"2024-05-09T07:54:38.114445+0000","last_clean":"2024-05-09T07:54:38.114445+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T07:54:38.114445+0000","last_undegraded":"2024-05-09T07:54:38.114445+0000","last_fullsized":"2024-05-09T07:54:38.114445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089405+0000","last_change":"2024-05-09T07:54:36.099522+0000","last_active":"2024-05-09T07:54:38.089405+0000","last_peered":"2024-05-09T07:54:38.089405+0000","last_clean":"2024-05-09T07:54:38.089405+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T07:54:38.089405+0000","last_undegraded":"2024-05-09T07:54:38.089405+0000","last_fullsized":"2024-05-09T07:54:38.089405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126052+0000","last_change":"2024-05-09T07:54:36.103352+0000","last_active":"2024-05-09T07:54:38.126052+0000","last_peered":"2024-05-09T07:54:38.126052+0000","last_clean":"2024-05-09T07:54:38.126052+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T07:54:38.126052+0000","last_undegraded":"2024-05-09T07:54:38.126052+0000","last_fullsized":"2024-05-09T07:54:38.126052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125742+0000","last_change":"2024-05-09T07:54:37.113565+0000","last_active":"2024-05-09T07:54:38.125742+0000","last_peered":"2024-05-09T07:54:38.125742+0000","last_clean":"2024-05-09T07:54:38.125742+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T07:54:38.125742+0000","last_undegraded":"2024-05-09T07:54:38.125742+0000","last_fullsized":"2024-05-09T07:54:38.125742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089786+0000","last_change":"2024-05-09T07:54:36.091893+0000","last_active":"2024-05-09T07:54:38.089786+0000","last_peered":"2024-05-09T07:54:38.089786+0000","last_clean":"2024-05-09T07:54:38.089786+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T07:54:38.089786+0000","last_undegraded":"2024-05-09T07:54:38.089786+0000","last_fullsized":"2024-05-09T07:54:38.089786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088976+0000","last_change":"2024-05-09T07:54:37.106284+0000","last_active":"2024-05-09T07:54:38.088976+0000","last_peered":"2024-05-09T07:54:38.088976+0000","last_clean":"2024-05-09T07:54:38.088976+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T07:54:38.088976+0000","last_undegraded":"2024-05-09T07:54:38.088976+0000","last_fullsized":"2024-05-09T07:54:38.088976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089802+0000","last_change":"2024-05-09T07:54:36.100068+0000","last_active":"2024-05-09T07:54:38.089802+0000","last_peered":"2024-05-09T07:54:38.089802+0000","last_clean":"2024-05-09T07:54:38.089802+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T07:54:38.089802+0000","last_undegraded":"2024-05-09T07:54:38.089802+0000","last_fullsized":"2024-05-09T07:54:38.089802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089637+0000","last_change":"2024-05-09T07:54:37.099653+0000","last_active":"2024-05-09T07:54:38.089637+0000","last_peered":"2024-05-09T07:54:38.089637+0000","last_clean":"2024-05-09T07:54:38.089637+0000","last_became_active":"2024-05-09T07:54:37.099256+0000","last_became_peered":"2024-05-09T07:54:37.099256+0000","last_unstale":"2024-05-09T07:54:38.089637+0000","last_undegraded":"2024-05-09T07:54:38.089637+0000","last_fullsized":"2024-05-09T07:54:38.089637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090072+0000","last_change":"2024-05-09T07:54:36.100368+0000","last_active":"2024-05-09T07:54:38.090072+0000","last_peered":"2024-05-09T07:54:38.090072+0000","last_clean":"2024-05-09T07:54:38.090072+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T07:54:38.090072+0000","last_undegraded":"2024-05-09T07:54:38.090072+0000","last_fullsized":"2024-05-09T07:54:38.090072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114311+0000","last_change":"2024-05-09T07:54:37.107847+0000","last_active":"2024-05-09T07:54:38.114311+0000","last_peered":"2024-05-09T07:54:38.114311+0000","last_clean":"2024-05-09T07:54:38.114311+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T07:54:38.114311+0000","last_undegraded":"2024-05-09T07:54:38.114311+0000","last_fullsized":"2024-05-09T07:54:38.114311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089184+0000","last_change":"2024-05-09T07:54:36.101694+0000","last_active":"2024-05-09T07:54:38.089184+0000","last_peered":"2024-05-09T07:54:38.089184+0000","last_clean":"2024-05-09T07:54:38.089184+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T07:54:38.089184+0000","last_undegraded":"2024-05-09T07:54:38.089184+0000","last_fullsized":"2024-05-09T07:54:38.089184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126626+0000","last_change":"2024-05-09T07:54:37.098733+0000","last_active":"2024-05-09T07:54:38.126626+0000","last_peered":"2024-05-09T07:54:38.126626+0000","last_clean":"2024-05-09T07:54:38.126626+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T07:54:38.126626+0000","last_undegraded":"2024-05-09T07:54:38.126626+0000","last_fullsized":"2024-05-09T07:54:38.126626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:15.571989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089966+0000","last_change":"2024-05-09T07:54:36.103096+0000","last_active":"2024-05-09T07:54:38.089966+0000","last_peered":"2024-05-09T07:54:38.089966+0000","last_clean":"2024-05-09T07:54:38.089966+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T07:54:38.089966+0000","last_undegraded":"2024-05-09T07:54:38.089966+0000","last_fullsized":"2024-05-09T07:54:38.089966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127096+0000","last_change":"2024-05-09T07:54:37.101875+0000","last_active":"2024-05-09T07:54:38.127096+0000","last_peered":"2024-05-09T07:54:38.127096+0000","last_clean":"2024-05-09T07:54:38.127096+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T07:54:38.127096+0000","last_undegraded":"2024-05-09T07:54:38.127096+0000","last_fullsized":"2024-05-09T07:54:38.127096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114462+0000","last_change":"2024-05-09T07:54:36.090977+0000","last_active":"2024-05-09T07:54:38.114462+0000","last_peered":"2024-05-09T07:54:38.114462+0000","last_clean":"2024-05-09T07:54:38.114462+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T07:54:38.114462+0000","last_undegraded":"2024-05-09T07:54:38.114462+0000","last_fullsized":"2024-05-09T07:54:38.114462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:17.768144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114204+0000","last_change":"2024-05-09T07:54:37.105813+0000","last_active":"2024-05-09T07:54:38.114204+0000","last_peered":"2024-05-09T07:54:38.114204+0000","last_clean":"2024-05-09T07:54:38.114204+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T07:54:38.114204+0000","last_undegraded":"2024-05-09T07:54:38.114204+0000","last_fullsized":"2024-05-09T07:54:38.114204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:02.185354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089886+0000","last_change":"2024-05-09T07:54:36.102510+0000","last_active":"2024-05-09T07:54:38.089886+0000","last_peered":"2024-05-09T07:54:38.089886+0000","last_clean":"2024-05-09T07:54:38.089886+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T07:54:38.089886+0000","last_undegraded":"2024-05-09T07:54:38.089886+0000","last_fullsized":"2024-05-09T07:54:38.089886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126997+0000","last_change":"2024-05-09T07:54:37.105015+0000","last_active":"2024-05-09T07:54:38.126997+0000","last_peered":"2024-05-09T07:54:38.126997+0000","last_clean":"2024-05-09T07:54:38.126997+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T07:54:38.126997+0000","last_undegraded":"2024-05-09T07:54:38.126997+0000","last_fullsized":"2024-05-09T07:54:38.126997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089058+0000","last_change":"2024-05-09T07:54:36.103721+0000","last_active":"2024-05-09T07:54:38.089058+0000","last_peered":"2024-05-09T07:54:38.089058+0000","last_clean":"2024-05-09T07:54:38.089058+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T07:54:38.089058+0000","last_undegraded":"2024-05-09T07:54:38.089058+0000","last_fullsized":"2024-05-09T07:54:38.089058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088980+0000","last_change":"2024-05-09T07:54:37.111215+0000","last_active":"2024-05-09T07:54:38.088980+0000","last_peered":"2024-05-09T07:54:38.088980+0000","last_clean":"2024-05-09T07:54:38.088980+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T07:54:38.088980+0000","last_undegraded":"2024-05-09T07:54:38.088980+0000","last_fullsized":"2024-05-09T07:54:38.088980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125695+0000","last_change":"2024-05-09T07:54:36.098598+0000","last_active":"2024-05-09T07:54:38.125695+0000","last_peered":"2024-05-09T07:54:38.125695+0000","last_clean":"2024-05-09T07:54:38.125695+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T07:54:38.125695+0000","last_undegraded":"2024-05-09T07:54:38.125695+0000","last_fullsized":"2024-05-09T07:54:38.125695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126550+0000","last_change":"2024-05-09T07:54:37.102764+0000","last_active":"2024-05-09T07:54:38.126550+0000","last_peered":"2024-05-09T07:54:38.126550+0000","last_clean":"2024-05-09T07:54:38.126550+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T07:54:38.126550+0000","last_undegraded":"2024-05-09T07:54:38.126550+0000","last_fullsized":"2024-05-09T07:54:38.126550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126466+0000","last_change":"2024-05-09T07:54:36.092365+0000","last_active":"2024-05-09T07:54:38.126466+0000","last_peered":"2024-05-09T07:54:38.126466+0000","last_clean":"2024-05-09T07:54:38.126466+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T07:54:38.126466+0000","last_undegraded":"2024-05-09T07:54:38.126466+0000","last_fullsized":"2024-05-09T07:54:38.126466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127009+0000","last_change":"2024-05-09T07:54:37.100214+0000","last_active":"2024-05-09T07:54:38.127009+0000","last_peered":"2024-05-09T07:54:38.127009+0000","last_clean":"2024-05-09T07:54:38.127009+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T07:54:38.127009+0000","last_undegraded":"2024-05-09T07:54:38.127009+0000","last_fullsized":"2024-05-09T07:54:38.127009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126065+0000","last_change":"2024-05-09T07:54:36.100004+0000","last_active":"2024-05-09T07:54:38.126065+0000","last_peered":"2024-05-09T07:54:38.126065+0000","last_clean":"2024-05-09T07:54:38.126065+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T07:54:38.126065+0000","last_undegraded":"2024-05-09T07:54:38.126065+0000","last_fullsized":"2024-05-09T07:54:38.126065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127108+0000","last_change":"2024-05-09T07:54:37.100879+0000","last_active":"2024-05-09T07:54:38.127108+0000","last_peered":"2024-05-09T07:54:38.127108+0000","last_clean":"2024-05-09T07:54:38.127108+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T07:54:38.127108+0000","last_undegraded":"2024-05-09T07:54:38.127108+0000","last_fullsized":"2024-05-09T07:54:38.127108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089145+0000","last_change":"2024-05-09T07:54:36.099594+0000","last_active":"2024-05-09T07:54:38.089145+0000","last_peered":"2024-05-09T07:54:38.089145+0000","last_clean":"2024-05-09T07:54:38.089145+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T07:54:38.089145+0000","last_undegraded":"2024-05-09T07:54:38.089145+0000","last_fullsized":"2024-05-09T07:54:38.089145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090354+0000","last_change":"2024-05-09T07:54:37.103885+0000","last_active":"2024-05-09T07:54:38.090354+0000","last_peered":"2024-05-09T07:54:38.090354+0000","last_clean":"2024-05-09T07:54:38.090354+0000","last_became_active":"2024-05-09T07:54:37.103150+0000","last_became_peered":"2024-05-09T07:54:37.103150+0000","last_unstale":"2024-05-09T07:54:38.090354+0000","last_undegraded":"2024-05-09T07:54:38.090354+0000","last_fullsized":"2024-05-09T07:54:38.090354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125835+0000","last_change":"2024-05-09T07:54:36.097398+0000","last_active":"2024-05-09T07:54:38.125835+0000","last_peered":"2024-05-09T07:54:38.125835+0000","last_clean":"2024-05-09T07:54:38.125835+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T07:54:38.125835+0000","last_undegraded":"2024-05-09T07:54:38.125835+0000","last_fullsized":"2024-05-09T07:54:38.125835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127276+0000","last_change":"2024-05-09T07:54:37.108574+0000","last_active":"2024-05-09T07:54:38.127276+0000","last_peered":"2024-05-09T07:54:38.127276+0000","last_clean":"2024-05-09T07:54:38.127276+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T07:54:38.127276+0000","last_undegraded":"2024-05-09T07:54:38.127276+0000","last_fullsized":"2024-05-09T07:54:38.127276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089307+0000","last_change":"2024-05-09T07:54:36.097635+0000","last_active":"2024-05-09T07:54:38.089307+0000","last_peered":"2024-05-09T07:54:38.089307+0000","last_clean":"2024-05-09T07:54:38.089307+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T07:54:38.089307+0000","last_undegraded":"2024-05-09T07:54:38.089307+0000","last_fullsized":"2024-05-09T07:54:38.089307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125983+0000","last_change":"2024-05-09T07:54:37.111470+0000","last_active":"2024-05-09T07:54:38.125983+0000","last_peered":"2024-05-09T07:54:38.125983+0000","last_clean":"2024-05-09T07:54:38.125983+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T07:54:38.125983+0000","last_undegraded":"2024-05-09T07:54:38.125983+0000","last_fullsized":"2024-05-09T07:54:38.125983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126209+0000","last_change":"2024-05-09T07:54:36.107162+0000","last_active":"2024-05-09T07:54:38.126209+0000","last_peered":"2024-05-09T07:54:38.126209+0000","last_clean":"2024-05-09T07:54:38.126209+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T07:54:38.126209+0000","last_undegraded":"2024-05-09T07:54:38.126209+0000","last_fullsized":"2024-05-09T07:54:38.126209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114106+0000","last_change":"2024-05-09T07:54:37.102062+0000","last_active":"2024-05-09T07:54:38.114106+0000","last_peered":"2024-05-09T07:54:38.114106+0000","last_clean":"2024-05-09T07:54:38.114106+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T07:54:38.114106+0000","last_undegraded":"2024-05-09T07:54:38.114106+0000","last_fullsized":"2024-05-09T07:54:38.114106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:32.555846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125875+0000","last_change":"2024-05-09T07:54:36.100227+0000","last_active":"2024-05-09T07:54:38.125875+0000","last_peered":"2024-05-09T07:54:38.125875+0000","last_clean":"2024-05-09T07:54:38.125875+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T07:54:38.125875+0000","last_undegraded":"2024-05-09T07:54:38.125875+0000","last_fullsized":"2024-05-09T07:54:38.125875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089178+0000","last_change":"2024-05-09T07:54:37.109167+0000","last_active":"2024-05-09T07:54:38.089178+0000","last_peered":"2024-05-09T07:54:38.089178+0000","last_clean":"2024-05-09T07:54:38.089178+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T07:54:38.089178+0000","last_undegraded":"2024-05-09T07:54:38.089178+0000","last_fullsized":"2024-05-09T07:54:38.089178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090002+0000","last_change":"2024-05-09T07:54:36.100426+0000","last_active":"2024-05-09T07:54:38.090002+0000","last_peered":"2024-05-09T07:54:38.090002+0000","last_clean":"2024-05-09T07:54:38.090002+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T07:54:38.090002+0000","last_undegraded":"2024-05-09T07:54:38.090002+0000","last_fullsized":"2024-05-09T07:54:38.090002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126610+0000","last_change":"2024-05-09T07:54:37.108794+0000","last_active":"2024-05-09T07:54:38.126610+0000","last_peered":"2024-05-09T07:54:38.126610+0000","last_clean":"2024-05-09T07:54:38.126610+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T07:54:38.126610+0000","last_undegraded":"2024-05-09T07:54:38.126610+0000","last_fullsized":"2024-05-09T07:54:38.126610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:43.498827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089162+0000","last_change":"2024-05-09T07:54:36.104155+0000","last_active":"2024-05-09T07:54:38.089162+0000","last_peered":"2024-05-09T07:54:38.089162+0000","last_clean":"2024-05-09T07:54:38.089162+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T07:54:38.089162+0000","last_undegraded":"2024-05-09T07:54:38.089162+0000","last_fullsized":"2024-05-09T07:54:38.089162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090218+0000","last_change":"2024-05-09T07:54:37.103562+0000","last_active":"2024-05-09T07:54:38.090218+0000","last_peered":"2024-05-09T07:54:38.090218+0000","last_clean":"2024-05-09T07:54:38.090218+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T07:54:38.090218+0000","last_undegraded":"2024-05-09T07:54:38.090218+0000","last_fullsized":"2024-05-09T07:54:38.090218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127376+0000","last_change":"2024-05-09T07:54:36.106399+0000","last_active":"2024-05-09T07:54:38.127376+0000","last_peered":"2024-05-09T07:54:38.127376+0000","last_clean":"2024-05-09T07:54:38.127376+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T07:54:38.127376+0000","last_undegraded":"2024-05-09T07:54:38.127376+0000","last_fullsized":"2024-05-09T07:54:38.127376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089072+0000","last_change":"2024-05-09T07:54:37.105988+0000","last_active":"2024-05-09T07:54:38.089072+0000","last_peered":"2024-05-09T07:54:38.089072+0000","last_clean":"2024-05-09T07:54:38.089072+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T07:54:38.089072+0000","last_undegraded":"2024-05-09T07:54:38.089072+0000","last_fullsized":"2024-05-09T07:54:38.089072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.102035+0000","last_change":"2024-05-09T07:54:36.101002+0000","last_active":"2024-05-09T07:54:38.102035+0000","last_peered":"2024-05-09T07:54:38.102035+0000","last_clean":"2024-05-09T07:54:38.102035+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T07:54:38.102035+0000","last_undegraded":"2024-05-09T07:54:38.102035+0000","last_fullsized":"2024-05-09T07:54:38.102035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126405+0000","last_change":"2024-05-09T07:54:37.100183+0000","last_active":"2024-05-09T07:54:38.126405+0000","last_peered":"2024-05-09T07:54:38.126405+0000","last_clean":"2024-05-09T07:54:38.126405+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T07:54:38.126405+0000","last_undegraded":"2024-05-09T07:54:38.126405+0000","last_fullsized":"2024-05-09T07:54:38.126405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089901+0000","last_change":"2024-05-09T07:54:36.105813+0000","last_active":"2024-05-09T07:54:38.089901+0000","last_peered":"2024-05-09T07:54:38.089901+0000","last_clean":"2024-05-09T07:54:38.089901+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T07:54:38.089901+0000","last_undegraded":"2024-05-09T07:54:38.089901+0000","last_fullsized":"2024-05-09T07:54:38.089901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114359+0000","last_change":"2024-05-09T07:54:37.107782+0000","last_active":"2024-05-09T07:54:38.114359+0000","last_peered":"2024-05-09T07:54:38.114359+0000","last_clean":"2024-05-09T07:54:38.114359+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T07:54:38.114359+0000","last_undegraded":"2024-05-09T07:54:38.114359+0000","last_fullsized":"2024-05-09T07:54:38.114359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125962+0000","last_change":"2024-05-09T07:54:36.106409+0000","last_active":"2024-05-09T07:54:38.125962+0000","last_peered":"2024-05-09T07:54:38.125962+0000","last_clean":"2024-05-09T07:54:38.125962+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T07:54:38.125962+0000","last_undegraded":"2024-05-09T07:54:38.125962+0000","last_fullsized":"2024-05-09T07:54:38.125962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126537+0000","last_change":"2024-05-09T07:54:37.104920+0000","last_active":"2024-05-09T07:54:38.126537+0000","last_peered":"2024-05-09T07:54:38.126537+0000","last_clean":"2024-05-09T07:54:38.126537+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T07:54:38.126537+0000","last_undegraded":"2024-05-09T07:54:38.126537+0000","last_fullsized":"2024-05-09T07:54:38.126537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089089+0000","last_change":"2024-05-09T07:54:36.105662+0000","last_active":"2024-05-09T07:54:38.089089+0000","last_peered":"2024-05-09T07:54:38.089089+0000","last_clean":"2024-05-09T07:54:38.089089+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T07:54:38.089089+0000","last_undegraded":"2024-05-09T07:54:38.089089+0000","last_fullsized":"2024-05-09T07:54:38.089089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125906+0000","last_change":"2024-05-09T07:54:37.103640+0000","last_active":"2024-05-09T07:54:38.125906+0000","last_peered":"2024-05-09T07:54:38.125906+0000","last_clean":"2024-05-09T07:54:38.125906+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T07:54:38.125906+0000","last_undegraded":"2024-05-09T07:54:38.125906+0000","last_fullsized":"2024-05-09T07:54:38.125906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089139+0000","last_change":"2024-05-09T07:54:36.102636+0000","last_active":"2024-05-09T07:54:38.089139+0000","last_peered":"2024-05-09T07:54:38.089139+0000","last_clean":"2024-05-09T07:54:38.089139+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T07:54:38.089139+0000","last_undegraded":"2024-05-09T07:54:38.089139+0000","last_fullsized":"2024-05-09T07:54:38.089139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126076+0000","last_change":"2024-05-09T07:54:37.113734+0000","last_active":"2024-05-09T07:54:38.126076+0000","last_peered":"2024-05-09T07:54:38.126076+0000","last_clean":"2024-05-09T07:54:38.126076+0000","last_became_active":"2024-05-09T07:54:37.113448+0000","last_became_peered":"2024-05-09T07:54:37.113448+0000","last_unstale":"2024-05-09T07:54:38.126076+0000","last_undegraded":"2024-05-09T07:54:38.126076+0000","last_fullsized":"2024-05-09T07:54:38.126076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127166+0000","last_change":"2024-05-09T07:54:36.104367+0000","last_active":"2024-05-09T07:54:38.127166+0000","last_peered":"2024-05-09T07:54:38.127166+0000","last_clean":"2024-05-09T07:54:38.127166+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T07:54:38.127166+0000","last_undegraded":"2024-05-09T07:54:38.127166+0000","last_fullsized":"2024-05-09T07:54:38.127166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088985+0000","last_change":"2024-05-09T07:54:37.111038+0000","last_active":"2024-05-09T07:54:38.088985+0000","last_peered":"2024-05-09T07:54:38.088985+0000","last_clean":"2024-05-09T07:54:38.088985+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T07:54:38.088985+0000","last_undegraded":"2024-05-09T07:54:38.088985+0000","last_fullsized":"2024-05-09T07:54:38.088985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089727+0000","last_change":"2024-05-09T07:54:37.091699+0000","last_active":"2024-05-09T07:54:38.089727+0000","last_peered":"2024-05-09T07:54:38.089727+0000","last_clean":"2024-05-09T07:54:38.089727+0000","last_became_active":"2024-05-09T07:54:37.091280+0000","last_became_peered":"2024-05-09T07:54:37.091280+0000","last_unstale":"2024-05-09T07:54:38.089727+0000","last_undegraded":"2024-05-09T07:54:38.089727+0000","last_fullsized":"2024-05-09T07:54:38.089727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127058+0000","last_change":"2024-05-09T07:54:36.105726+0000","last_active":"2024-05-09T07:54:38.127058+0000","last_peered":"2024-05-09T07:54:38.127058+0000","last_clean":"2024-05-09T07:54:38.127058+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T07:54:38.127058+0000","last_undegraded":"2024-05-09T07:54:38.127058+0000","last_fullsized":"2024-05-09T07:54:38.127058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090261+0000","last_change":"2024-05-09T07:54:37.092061+0000","last_active":"2024-05-09T07:54:38.090261+0000","last_peered":"2024-05-09T07:54:38.090261+0000","last_clean":"2024-05-09T07:54:38.090261+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T07:54:38.090261+0000","last_undegraded":"2024-05-09T07:54:38.090261+0000","last_fullsized":"2024-05-09T07:54:38.090261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127214+0000","last_change":"2024-05-09T07:54:36.106635+0000","last_active":"2024-05-09T07:54:38.127214+0000","last_peered":"2024-05-09T07:54:38.127214+0000","last_clean":"2024-05-09T07:54:38.127214+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T07:54:38.127214+0000","last_undegraded":"2024-05-09T07:54:38.127214+0000","last_fullsized":"2024-05-09T07:54:38.127214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114272+0000","last_change":"2024-05-09T07:54:37.108470+0000","last_active":"2024-05-09T07:54:38.114272+0000","last_peered":"2024-05-09T07:54:38.114272+0000","last_clean":"2024-05-09T07:54:38.114272+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T07:54:38.114272+0000","last_undegraded":"2024-05-09T07:54:38.114272+0000","last_fullsized":"2024-05-09T07:54:38.114272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126415+0000","last_change":"2024-05-09T07:54:36.102502+0000","last_active":"2024-05-09T07:54:38.126415+0000","last_peered":"2024-05-09T07:54:38.126415+0000","last_clean":"2024-05-09T07:54:38.126415+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T07:54:38.126415+0000","last_undegraded":"2024-05-09T07:54:38.126415+0000","last_fullsized":"2024-05-09T07:54:38.126415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126360+0000","last_change":"2024-05-09T07:54:37.104598+0000","last_active":"2024-05-09T07:54:38.126360+0000","last_peered":"2024-05-09T07:54:38.126360+0000","last_clean":"2024-05-09T07:54:38.126360+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T07:54:38.126360+0000","last_undegraded":"2024-05-09T07:54:38.126360+0000","last_fullsized":"2024-05-09T07:54:38.126360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114410+0000","last_change":"2024-05-09T07:54:36.101744+0000","last_active":"2024-05-09T07:54:38.114410+0000","last_peered":"2024-05-09T07:54:38.114410+0000","last_clean":"2024-05-09T07:54:38.114410+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T07:54:38.114410+0000","last_undegraded":"2024-05-09T07:54:38.114410+0000","last_fullsized":"2024-05-09T07:54:38.114410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":665995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":76657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T07:54:45.147 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-09T07:54:45.147 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T07:54:45.147 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-09T07:54:45.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-09T07:54:45.148 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-09T07:54:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.269+0000 7f5268b7e640 1 Processor -- start 2024-05-09T07:54:45.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.269+0000 7f5268b7e640 1 -- start start 2024-05-09T07:54:45.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.270+0000 7f5268b7e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52640b5e20 0x7f5264147720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.270+0000 7f5268b7e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f52640b3e30 0x7f5264141580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.270+0000 7f5268b7e640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52640b5900 con 0x7f5264141ac0 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.270+0000 7f5268b7e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5264141f10 con 0x7f52640b5e20 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.270+0000 7f5268b7e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f52640b50c0 con 0x7f52640b3e30 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.270+0000 7f526259c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f52640b5e20 0x7f5264147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.270+0000 7f5262d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5264141ac0 0x7f52640b7980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43556/0 (socket says 172.21.15.87:43556) 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.270+0000 7f5262d9d640 1 -- 172.21.15.87:0/118643720 learned_addr learned my addr 172.21.15.87:0/118643720 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f5261d9b640 1 --2- 172.21.15.87:0/118643720 >> v2:172.21.15.110:3300/0 conn(0x7f52640b3e30 0x7f5264141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f526259c640 1 -- 172.21.15.87:0/118643720 >> v2:172.21.15.110:3300/0 conn(0x7f52640b3e30 msgr2=0x7f5264141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f526259c640 1 --2- 172.21.15.87:0/118643720 >> v2:172.21.15.110:3300/0 conn(0x7f52640b3e30 0x7f5264141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f526259c640 1 -- 172.21.15.87:0/118643720 >> v1:172.21.15.87:6789/0 conn(0x7f5264141ac0 legacy=0x7f52640b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f526159a640 1 -- 172.21.15.87:0/118643720 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454113489 0 0) 0x7f52640b5900 con 0x7f5264141ac0 2024-05-09T07:54:45.286 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f526259c640 1 -- 172.21.15.87:0/118643720 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52640b4a70 con 0x7f52640b5e20 2024-05-09T07:54:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f526259c640 1 --2- 172.21.15.87:0/118643720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b5e20 0x7f5264147720 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52640b7250 tx=0x7f525402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d55712f33a48d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f526159a640 1 -- 172.21.15.87:0/118643720 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254007740 con 0x7f52640b5e20 2024-05-09T07:54:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f526159a640 1 -- 172.21.15.87:0/118643720 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52540078e0 con 0x7f52640b5e20 2024-05-09T07:54:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.271+0000 7f526159a640 1 -- 172.21.15.87:0/118643720 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254007cb0 con 0x7f52640b5e20 2024-05-09T07:54:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.272+0000 7f5268b7e640 1 -- 172.21.15.87:0/118643720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b5e20 msgr2=0x7f5264147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.272+0000 7f5268b7e640 1 --2- 172.21.15.87:0/118643720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b5e20 0x7f5264147720 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f52640b7250 tx=0x7f525402a6c0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.272+0000 7f5268b7e640 1 -- 172.21.15.87:0/118643720 shutdown_connections 2024-05-09T07:54:45.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.272+0000 7f5268b7e640 1 --2- 172.21.15.87:0/118643720 >> v2:172.21.15.110:3300/0 conn(0x7f52640b3e30 0x7f5264141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.272+0000 7f5268b7e640 1 --2- 172.21.15.87:0/118643720 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b5e20 0x7f5264147720 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.272+0000 7f5268b7e640 1 -- 172.21.15.87:0/118643720 >> 172.21.15.87:0/118643720 conn(0x7f52640676a0 msgr2=0x7f52640bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.272+0000 7f5268b7e640 1 -- 172.21.15.87:0/118643720 shutdown_connections 2024-05-09T07:54:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.272+0000 7f5268b7e640 1 -- 172.21.15.87:0/118643720 wait complete. 2024-05-09T07:54:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.273+0000 7f5268b7e640 1 Processor -- start 2024-05-09T07:54:45.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.273+0000 7f5268b7e640 1 -- start start 2024-05-09T07:54:45.291 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f5268b7e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b3e30 0x7f52641e0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f5268b7e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52640b5e20 0x7f5264144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f5268b7e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5264141ac0 0x7f5264144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f5268b7e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f52640b5550 con 0x7f52640b3e30 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f5268b7e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f52640b6200 con 0x7f5264141ac0 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f5268b7e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f52640bb060 con 0x7f52640b5e20 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f526259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b3e30 0x7f52641e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f526259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b3e30 0x7f52641e0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55482/0 (socket says 172.21.15.87:55482) 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f526259c640 1 -- 172.21.15.87:0/876035242 learned_addr learned my addr 172.21.15.87:0/876035242 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f526259c640 1 -- 172.21.15.87:0/876035242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52640b5e20 msgr2=0x7f5264144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f526259c640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52640b5e20 0x7f5264144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f526259c640 1 -- 172.21.15.87:0/876035242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5264141ac0 msgr2=0x7f5264144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f5262d9d640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5264141ac0 0x7f5264144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f526259c640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5264141ac0 0x7f5264144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f526259c640 1 -- 172.21.15.87:0/876035242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526413b200 con 0x7f52640b3e30 2024-05-09T07:54:45.292 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.274+0000 7f526259c640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b3e30 0x7f52641e0610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5254009ed0 tx=0x7f5254004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.275+0000 7f5252ffd640 1 -- 172.21.15.87:0/876035242 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254040070 con 0x7f52640b3e30 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.275+0000 7f5252ffd640 1 -- 172.21.15.87:0/876035242 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5254031c40 con 0x7f52640b3e30 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.275+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52641e0f10 con 0x7f52640b3e30 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.275+0000 7f5252ffd640 1 -- 172.21.15.87:0/876035242 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254009450 con 0x7f52640b3e30 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.275+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52641e0b50 con 0x7f52640b3e30 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.276+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52640691f0 con 0x7f52640b3e30 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.276+0000 7f5252ffd640 1 -- 172.21.15.87:0/876035242 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5254039040 con 0x7f52640b3e30 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.276+0000 7f5252ffd640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f524406be30 0x7f524406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.277+0000 7f5252ffd640 1 -- 172.21.15.87:0/876035242 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f52540ac2c0 con 0x7f52640b3e30 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.277+0000 7f5261d9b640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f524406be30 0x7f524406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.277+0000 7f5261d9b640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f524406be30 0x7f524406e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f526414b330 tx=0x7f5258008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:45.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.281+0000 7f5252ffd640 1 -- 172.21.15.87:0/876035242 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5254038350 con 0x7f52640b3e30 2024-05-09T07:54:45.517 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.502+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f526413eff0 con 0x7f52640b3e30 2024-05-09T07:54:45.519 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.505+0000 7f5252ffd640 1 -- 172.21.15.87:0/876035242 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172938 (secure 0 0 0) 0x7f525407ad00 con 0x7f52640b3e30 2024-05-09T07:54:45.522 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:45.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f524406be30 msgr2=0x7f524406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f524406be30 0x7f524406e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f526414b330 tx=0x7f5258008040 comp rx=0 tx=0).stop 2024-05-09T07:54:45.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b3e30 msgr2=0x7f52641e0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b3e30 0x7f52641e0610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5254009ed0 tx=0x7f5254004a40 comp rx=0 tx=0).stop 2024-05-09T07:54:45.523 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 shutdown_connections 2024-05-09T07:54:45.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f524406be30 0x7f524406e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52640b5e20 0x7f5264144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5264141ac0 0x7f5264144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 --2- 172.21.15.87:0/876035242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f52640b3e30 0x7f52641e0610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 >> 172.21.15.87:0/876035242 conn(0x7f52640676a0 msgr2=0x7f52640b9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:45.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 shutdown_connections 2024-05-09T07:54:45.524 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.507+0000 7f5268b7e640 1 -- 172.21.15.87:0/876035242 wait complete. 2024-05-09T07:54:45.533 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":1321160324},{"type":"v1","addr":"172.21.15.87:6833","nonce":1321160324}]},"active_addr":"172.21.15.87:6833/1321160324","active_change":"2024-05-09T07:54:16.881346+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":2360778072}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":334967867}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3508437055}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3353797740}]}]} 2024-05-09T07:54:45.536 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-09T07:54:45.536 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T07:54:45.536 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:45.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.621+0000 7f6752e64640 1 Processor -- start 2024-05-09T07:54:45.636 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.621+0000 7f6752e64640 1 -- start start 2024-05-09T07:54:45.638 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f6752e64640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f674c0b5330 0x7f674c0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f6752e64640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b2940 0x7f674c147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f6752e64640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f674c0b6240 con 0x7f674c0b5e60 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f6752e64640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f674c0b0470 con 0x7f674c0b5330 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f6752e64640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f674c0b1580 con 0x7f674c0b2940 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f674bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f674c0b5330 0x7f674c0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f674bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f674c0b5330 0x7f674c0b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55492/0 (socket says 172.21.15.87:55492) 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f674bfff640 1 -- 172.21.15.87:0/728378996 learned_addr learned my addr 172.21.15.87:0/728378996 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f6751401640 1 --2- 172.21.15.87:0/728378996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b2940 0x7f674c147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f674bfff640 1 -- 172.21.15.87:0/728378996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b2940 msgr2=0x7f674c147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f674bfff640 1 --2- 172.21.15.87:0/728378996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b2940 0x7f674c147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f674bfff640 1 -- 172.21.15.87:0/728378996 >> v1:172.21.15.110:6789/0 conn(0x7f674c0b5e60 legacy=0x7f674c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.622+0000 7f674bfff640 1 -- 172.21.15.87:0/728378996 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c0b1860 con 0x7f674c0b5330 2024-05-09T07:54:45.639 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.623+0000 7f674bfff640 1 --2- 172.21.15.87:0/728378996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b5330 0x7f674c0b2400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67400098a0 tx=0x7f674002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1c1bd8c062346b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.623+0000 7f674b7fe640 1 -- 172.21.15.87:0/728378996 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740037070 con 0x7f674c0b5330 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.623+0000 7f674b7fe640 1 -- 172.21.15.87:0/728378996 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6740032440 con 0x7f674c0b5330 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.623+0000 7f674b7fe640 1 -- 172.21.15.87:0/728378996 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740032810 con 0x7f674c0b5330 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.624+0000 7f6752e64640 1 -- 172.21.15.87:0/728378996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b5330 msgr2=0x7f674c0b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.624+0000 7f6752e64640 1 --2- 172.21.15.87:0/728378996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b5330 0x7f674c0b2400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67400098a0 tx=0x7f674002a200 comp rx=0 tx=0).stop 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.624+0000 7f6752e64640 1 -- 172.21.15.87:0/728378996 shutdown_connections 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.624+0000 7f6752e64640 1 --2- 172.21.15.87:0/728378996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b2940 0x7f674c147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.624+0000 7f6752e64640 1 --2- 172.21.15.87:0/728378996 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b5330 0x7f674c0b2400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.624+0000 7f6752e64640 1 -- 172.21.15.87:0/728378996 >> 172.21.15.87:0/728378996 conn(0x7f674c06c6a0 msgr2=0x7f674c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.624+0000 7f6752e64640 1 -- 172.21.15.87:0/728378996 shutdown_connections 2024-05-09T07:54:45.640 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.624+0000 7f6752e64640 1 -- 172.21.15.87:0/728378996 wait complete. 2024-05-09T07:54:45.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.625+0000 7f6752e64640 1 Processor -- start 2024-05-09T07:54:45.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.625+0000 7f6752e64640 1 -- start start 2024-05-09T07:54:45.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6752e64640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b2940 0x7f674c146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6752e64640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f674c0b5330 0x7f674c151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6752e64640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b5e60 0x7f674c13af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6752e64640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f674c0afae0 con 0x7f674c0b2940 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6752e64640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f674c0af960 con 0x7f674c0b5330 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6752e64640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f674c148110 con 0x7f674c0b5e60 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6750c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b2940 0x7f674c146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6750c00640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b2940 0x7f674c146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55504/0 (socket says 172.21.15.87:55504) 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6750c00640 1 -- 172.21.15.87:0/326904821 learned_addr learned my addr 172.21.15.87:0/326904821 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f674bfff640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f674c0b5330 0x7f674c151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6751401640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b5e60 0x7f674c13af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6750c00640 1 -- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b5e60 msgr2=0x7f674c13af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6750c00640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b5e60 0x7f674c13af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6750c00640 1 -- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f674c0b5330 msgr2=0x7f674c151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6750c00640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f674c0b5330 0x7f674c151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6750c00640 1 -- 172.21.15.87:0/326904821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c0b8d50 con 0x7f674c0b2940 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f674bfff640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f674c0b5330 0x7f674c151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6751401640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b5e60 0x7f674c13af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6750c00640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b2940 0x7f674c146ca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c3c0 tx=0x7f673c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f67497fa640 1 -- 172.21.15.87:0/326904821 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c0052d0 con 0x7f674c0b2940 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f67497fa640 1 -- 172.21.15.87:0/326904821 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673c005490 con 0x7f674c0b2940 2024-05-09T07:54:45.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674c0b9610 con 0x7f674c0b2940 2024-05-09T07:54:45.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f67497fa640 1 -- 172.21.15.87:0/326904821 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c007260 con 0x7f674c0b2940 2024-05-09T07:54:45.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.626+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674c0b8a70 con 0x7f674c0b2940 2024-05-09T07:54:45.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.627+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f674c0691f0 con 0x7f674c0b2940 2024-05-09T07:54:45.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.628+0000 7f67497fa640 1 -- 172.21.15.87:0/326904821 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f673c007400 con 0x7f674c0b2940 2024-05-09T07:54:45.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.628+0000 7f67497fa640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f673806be60 0x7f673806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.628+0000 7f67497fa640 1 -- 172.21.15.87:0/326904821 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f673c08a250 con 0x7f674c0b2940 2024-05-09T07:54:45.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.628+0000 7f674bfff640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f673806be60 0x7f673806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.629+0000 7f674bfff640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f673806be60 0x7f673806e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6740034000 tx=0x7f674002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:45.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.632+0000 7f67497fa640 1 -- 172.21.15.87:0/326904821 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f673c058c90 con 0x7f674c0b2940 2024-05-09T07:54:45.822 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.808+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f674c0710e0 con 0x7f674c0b2940 2024-05-09T07:54:45.823 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.809+0000 7f67497fa640 1 -- 172.21.15.87:0/326904821 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f673c058590 con 0x7f674c0b2940 2024-05-09T07:54:45.824 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:45.824 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":21,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:38.084989+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f673806be60 msgr2=0x7f673806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f673806be60 0x7f673806e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6740034000 tx=0x7f674002e000 comp rx=0 tx=0).stop 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b2940 msgr2=0x7f674c146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b2940 0x7f674c146ca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c3c0 tx=0x7f673c00c880 comp rx=0 tx=0).stop 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 shutdown_connections 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f673806be60 0x7f673806e320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f674c0b5e60 0x7f674c13af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f674c0b5330 0x7f674c151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 --2- 172.21.15.87:0/326904821 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f674c0b2940 0x7f674c146ca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 >> 172.21.15.87:0/326904821 conn(0x7f674c06c6a0 msgr2=0x7f674c0b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:45.826 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 shutdown_connections 2024-05-09T07:54:45.827 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.811+0000 7f6752e64640 1 -- 172.21.15.87:0/326904821 wait complete. 2024-05-09T07:54:45.837 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T07:54:45.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:45.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.922+0000 7f534495c640 1 Processor -- start 2024-05-09T07:54:45.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.922+0000 7f534495c640 1 -- start start 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f534495c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b5e20 0x7f5340147720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f534495c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5340141c90 0x7f5340152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f534495c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53400b5900 con 0x7f53400b3e30 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f534495c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f53400b50c0 con 0x7f5340141c90 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f534495c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f53400b4a70 con 0x7f53400b5e20 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f533ed9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5340141c90 0x7f5340152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f533dd9b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f53400b3e30 0x7f5340141580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43560/0 (socket says 172.21.15.87:43560) 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f533dd9b640 1 -- 172.21.15.87:0/770829691 learned_addr learned my addr 172.21.15.87:0/770829691 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f533e59c640 1 --2- 172.21.15.87:0/770829691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b5e20 0x7f5340147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.923+0000 7f533ed9d640 1 -- 172.21.15.87:0/770829691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b5e20 msgr2=0x7f5340147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:45.939 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.924+0000 7f533ed9d640 1 --2- 172.21.15.87:0/770829691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b5e20 0x7f5340147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.924+0000 7f533ed9d640 1 -- 172.21.15.87:0/770829691 >> v1:172.21.15.87:6789/0 conn(0x7f53400b3e30 legacy=0x7f5340141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.924+0000 7f533d59a640 1 -- 172.21.15.87:0/770829691 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2792735591 0 0) 0x7f53400b5900 con 0x7f53400b3e30 2024-05-09T07:54:45.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.924+0000 7f533ed9d640 1 -- 172.21.15.87:0/770829691 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53400b4d50 con 0x7f5340141c90 2024-05-09T07:54:45.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.924+0000 7f533ed9d640 1 --2- 172.21.15.87:0/770829691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5340141c90 0x7f5340152080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53380097a0 tx=0x7f533802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc25b496ee75cb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:45.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.924+0000 7f533d59a640 1 -- 172.21.15.87:0/770829691 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338037070 con 0x7f5340141c90 2024-05-09T07:54:45.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.924+0000 7f533d59a640 1 -- 172.21.15.87:0/770829691 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5338032440 con 0x7f5340141c90 2024-05-09T07:54:45.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.924+0000 7f533d59a640 1 -- 172.21.15.87:0/770829691 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338032810 con 0x7f5340141c90 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.925+0000 7f534495c640 1 -- 172.21.15.87:0/770829691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5340141c90 msgr2=0x7f5340152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.925+0000 7f534495c640 1 --2- 172.21.15.87:0/770829691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5340141c90 0x7f5340152080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53380097a0 tx=0x7f533802a180 comp rx=0 tx=0).stop 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.925+0000 7f534495c640 1 -- 172.21.15.87:0/770829691 shutdown_connections 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.925+0000 7f534495c640 1 --2- 172.21.15.87:0/770829691 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5340141c90 0x7f5340152080 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.925+0000 7f534495c640 1 --2- 172.21.15.87:0/770829691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b5e20 0x7f5340147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.925+0000 7f534495c640 1 -- 172.21.15.87:0/770829691 >> 172.21.15.87:0/770829691 conn(0x7f53400676a0 msgr2=0x7f53400bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.925+0000 7f534495c640 1 -- 172.21.15.87:0/770829691 shutdown_connections 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.925+0000 7f534495c640 1 -- 172.21.15.87:0/770829691 wait complete. 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.926+0000 7f534495c640 1 Processor -- start 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.926+0000 7f534495c640 1 -- start start 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f534495c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b3e30 0x7f5340149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f534495c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53400b5e20 0x7f5340143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f534495c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5340141c90 0x7f53401441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f534495c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f53400b5550 con 0x7f53400b5e20 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f534495c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f53400bdbc0 con 0x7f5340141c90 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f534495c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f53400a9bb0 con 0x7f53400b3e30 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53400b5e20 0x7f5340143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533dd9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53400b5e20 0x7f5340143cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55520/0 (socket says 172.21.15.87:55520) 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533dd9b640 1 -- 172.21.15.87:0/1056392252 learned_addr learned my addr 172.21.15.87:0/1056392252 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533e59c640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b3e30 0x7f5340149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533ed9d640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5340141c90 0x7f53401441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533dd9b640 1 -- 172.21.15.87:0/1056392252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b3e30 msgr2=0x7f5340149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533dd9b640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b3e30 0x7f5340149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533dd9b640 1 -- 172.21.15.87:0/1056392252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5340141c90 msgr2=0x7f53401441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533dd9b640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5340141c90 0x7f53401441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533dd9b640 1 -- 172.21.15.87:0/1056392252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534014b550 con 0x7f53400b5e20 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f533dd9b640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53400b5e20 0x7f5340143cb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f532800c4d0 tx=0x7f532800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:45.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f5336ffd640 1 -- 172.21.15.87:0/1056392252 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328018070 con 0x7f53400b5e20 2024-05-09T07:54:45.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.927+0000 7f5336ffd640 1 -- 172.21.15.87:0/1056392252 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5328007500 con 0x7f53400b5e20 2024-05-09T07:54:45.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.928+0000 7f5336ffd640 1 -- 172.21.15.87:0/1056392252 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5328004a20 con 0x7f53400b5e20 2024-05-09T07:54:45.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.928+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534014a6c0 con 0x7f53400b5e20 2024-05-09T07:54:45.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.928+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5340143790 con 0x7f53400b5e20 2024-05-09T07:54:45.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.928+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5340143990 con 0x7f53400b5e20 2024-05-09T07:54:45.945 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.929+0000 7f5336ffd640 1 -- 172.21.15.87:0/1056392252 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f532801b070 con 0x7f53400b5e20 2024-05-09T07:54:45.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.929+0000 7f5336ffd640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f532006be30 0x7f532006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:45.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.929+0000 7f5336ffd640 1 -- 172.21.15.87:0/1056392252 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f532808a070 con 0x7f53400b5e20 2024-05-09T07:54:45.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.929+0000 7f533e59c640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f532006be30 0x7f532006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:45.946 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.930+0000 7f533e59c640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f532006be30 0x7f532006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5330003b80 tx=0x7f53300098f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:45.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:45.934+0000 7f5336ffd640 1 -- 172.21.15.87:0/1056392252 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5340143990 con 0x7f53400b5e20 2024-05-09T07:54:46.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.106+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53400691f0 con 0x7f53400b5e20 2024-05-09T07:54:46.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.107+0000 7f5336ffd640 1 -- 172.21.15.87:0/1056392252 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f534014b550 con 0x7f53400b5e20 2024-05-09T07:54:46.122 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:46.122 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":21,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:38.084989+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:46.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f532006be30 msgr2=0x7f532006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f532006be30 0x7f532006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5330003b80 tx=0x7f53300098f0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53400b5e20 msgr2=0x7f5340143cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53400b5e20 0x7f5340143cb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f532800c4d0 tx=0x7f532800c990 comp rx=0 tx=0).stop 2024-05-09T07:54:46.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 shutdown_connections 2024-05-09T07:54:46.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f532006be30 0x7f532006e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5340141c90 0x7f53401441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f53400b5e20 0x7f5340143cb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 --2- 172.21.15.87:0/1056392252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53400b3e30 0x7f5340149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.109+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 >> 172.21.15.87:0/1056392252 conn(0x7f53400676a0 msgr2=0x7f53400b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.110+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 shutdown_connections 2024-05-09T07:54:46.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.110+0000 7f534495c640 1 -- 172.21.15.87:0/1056392252 wait complete. 2024-05-09T07:54:46.135 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T07:54:46.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T07:54:46.136 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T07:54:46.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T07:54:46.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-09T07:54:46.137 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-09T07:54:46.138 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-09T07:54:46.138 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-09T07:54:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.293+0000 7fc39835a640 1 Processor -- start 2024-05-09T07:54:46.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.293+0000 7fc39835a640 1 -- start start 2024-05-09T07:54:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7f995947d640 1 Processor -- start 2024-05-09T07:54:46.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7f995947d640 1 -- start start 2024-05-09T07:54:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7f54a9e68640 1 Processor -- start 2024-05-09T07:54:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7f54a9e68640 1 -- start start 2024-05-09T07:54:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7fc39835a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc39006bbb0 0x7fc39009b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7fc39835a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc390147bd0 0x7fc390148060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7fc39835a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3901485a0 con 0x7fc39014af20 2024-05-09T07:54:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7fc39835a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc39014bcd0 con 0x7fc39006bbb0 2024-05-09T07:54:46.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7fc39835a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc39006bf90 con 0x7fc390147bd0 2024-05-09T07:54:46.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7fc3958f5640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc39014af20 0x7fc390141950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43566/0 (socket says 172.21.15.87:43566) 2024-05-09T07:54:46.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7fc3958f5640 1 -- 172.21.15.87:0/1285585922 learned_addr learned my addr 172.21.15.87:0/1285585922 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7fc3968f7640 1 --2- 172.21.15.87:0/1285585922 >> v2:172.21.15.110:3300/0 conn(0x7fc390147bd0 0x7fc390148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.294+0000 7fdefffff640 1 Processor -- start 2024-05-09T07:54:46.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fc3960f6640 1 --2- 172.21.15.87:0/1285585922 >> v2:172.21.15.87:3300/0 conn(0x7fc39006bbb0 0x7fc39009b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fdefffff640 1 -- start start 2024-05-09T07:54:46.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 140425878 0 0) 0x7fc3901485a0 con 0x7fc39014af20 2024-05-09T07:54:46.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc37c003520 con 0x7fc39014af20 2024-05-09T07:54:46.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2314075749 0 0) 0x7fc37c003520 con 0x7fc39014af20 2024-05-09T07:54:46.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 >> v2:172.21.15.110:3300/0 conn(0x7fc390147bd0 msgr2=0x7fc390148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fc3950f4640 1 --2- 172.21.15.87:0/1285585922 >> v2:172.21.15.110:3300/0 conn(0x7fc390147bd0 0x7fc390148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 >> v2:172.21.15.87:3300/0 conn(0x7fc39006bbb0 msgr2=0x7fc39009b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fc3950f4640 1 --2- 172.21.15.87:0/1285585922 >> v2:172.21.15.87:3300/0 conn(0x7fc39006bbb0 0x7fc39009b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39014b680 con 0x7fc39014af20 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7fc38c001670 con 0x7fc39014af20 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 >> v1:172.21.15.87:6789/0 conn(0x7fc39014af20 legacy=0x7fc390141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3950f4640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c003a80 0x7fc37c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3950f4640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc37c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3950f4640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc37c0051c0 0x7fc37c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc39014bcd0 con 0x7fc37c0051c0 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc39006bf90 con 0x7fc37c004800 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc37c00c090 con 0x7fc37c003a80 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3958f5640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc37c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fc3960f6640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c003a80 0x7fc37c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f54a9e68640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f549c006240 0x7f549c0c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f54a9e68640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549c038c10 con 0x7f549c0066c0 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f54a9e68640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549c0c8a20 con 0x7f549c037360 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f54a9e68640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f549c0ccd80 con 0x7f549c006240 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f54a3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f549c006240 0x7f549c0c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f54a3fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f549c006240 0x7f549c0c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55540/0 (socket says 172.21.15.87:55540) 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f54a8e66640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f549c037360 0x7f549c0cc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:51426/0 (socket says 172.21.15.87:51426) 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f54a8e66640 1 -- 172.21.15.87:0/319705369 learned_addr learned my addr 172.21.15.87:0/319705369 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f54a37fe640 1 -- 172.21.15.87:0/319705369 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1110503898 0 0) 0x7f549c0c8a20 con 0x7f549c037360 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f54a37fe640 1 -- 172.21.15.87:0/319705369 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5494003520 con 0x7f549c037360 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f54a37fe640 1 -- 172.21.15.87:0/319705369 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1810137483 0 0) 0x7f5494003520 con 0x7f549c037360 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f54a3fff640 1 -- 172.21.15.87:0/319705369 >> v1:172.21.15.110:6789/0 conn(0x7f549c037360 legacy=0x7f549c0cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f54a3fff640 1 -- 172.21.15.87:0/319705369 >> v1:172.21.15.87:6789/0 conn(0x7f549c0066c0 legacy=0x7f549c0c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f54a3fff640 1 -- 172.21.15.87:0/319705369 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549c0c8ce0 con 0x7f549c006240 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fdefffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdef8039a50 0x7fdef8006cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fdefeffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdef8039a50 0x7fdef8006cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fdefeffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdef8039a50 0x7fdef8006cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55554/0 (socket says 172.21.15.87:55554) 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fdefeffd640 1 -- 172.21.15.87:0/3298635708 learned_addr learned my addr 172.21.15.87:0/3298635708 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fdefffff640 1 --2- 172.21.15.87:0/3298635708 >> v2:172.21.15.110:3300/0 conn(0x7fdef80382a0 0x7fdef8038700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fdefe7fc640 1 --2- 172.21.15.87:0/3298635708 >> v2:172.21.15.110:3300/0 conn(0x7fdef80382a0 0x7fdef8038700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fdefffff640 1 -- 172.21.15.87:0/3298635708 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef8038c40 con 0x7fdef80cdbb0 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fdefffff640 1 -- 172.21.15.87:0/3298635708 --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fdef803ae90 con 0x7fdef8039a50 2024-05-09T07:54:46.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fdefffff640 1 -- 172.21.15.87:0/3298635708 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fdef803b450 con 0x7fdef80382a0 2024-05-09T07:54:46.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fad3a885640 1 Processor -- start 2024-05-09T07:54:46.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f5c8ee7d640 1 Processor -- start 2024-05-09T07:54:46.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f995947d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99540b57a0 0x7f9954145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f995947d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b45e0 0x7f995414c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f995947d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99540b6070 con 0x7f99540b5b80 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f995947d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f995414be70 con 0x7f99540b57a0 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f995947d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f99540b6fc0 con 0x7f99540b45e0 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f99527fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b45e0 0x7f995414c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f99527fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b45e0 0x7f995414c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47522/0 (socket says 172.21.15.87:47522) 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f99527fc640 1 -- 172.21.15.87:0/2067542003 learned_addr learned my addr 172.21.15.87:0/2067542003 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f99527fc640 1 -- 172.21.15.87:0/2067542003 >> v2:172.21.15.110:3300/0 conn(0x7f99540b57a0 msgr2=0x7f9954145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f99527fc640 1 --2- 172.21.15.87:0/2067542003 >> v2:172.21.15.110:3300/0 conn(0x7f99540b57a0 0x7f9954145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f99527fc640 1 -- 172.21.15.87:0/2067542003 >> v1:172.21.15.110:6789/0 conn(0x7f99540b5b80 legacy=0x7f995414f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7f99527fc640 1 -- 172.21.15.87:0/2067542003 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99540b5080 con 0x7f99540b45e0 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f9f8d332640 1 Processor -- start 2024-05-09T07:54:46.316 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f9f8d332640 1 -- start start 2024-05-09T07:54:46.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.295+0000 7fad3a885640 1 -- start start 2024-05-09T07:54:46.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fad3a885640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad2c0ca690 0x7fad2c0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fad3a885640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad2c0d1180 0x7fad2c0d1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fad3a885640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2c035430 con 0x7fad2c036b60 2024-05-09T07:54:46.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fad3a885640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fad2c0d0cf0 con 0x7fad2c0ca690 2024-05-09T07:54:46.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fad3a885640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fad2c038380 con 0x7fad2c0d1180 2024-05-09T07:54:46.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fad39883640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fad2c036b60 0x7fad2c0d4450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:51444/0 (socket says 172.21.15.87:51444) 2024-05-09T07:54:46.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fad39883640 1 -- 172.21.15.87:0/3422138279 learned_addr learned my addr 172.21.15.87:0/3422138279 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fae049ab640 1 Processor -- start 2024-05-09T07:54:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7fae049ab640 1 -- start start 2024-05-09T07:54:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7f99527fc640 1 --2- 172.21.15.87:0/2067542003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b45e0 0x7f995414c300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9944009850 tx=0x7f994402a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48734b6970ec19e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fdefeffd640 1 -- 172.21.15.87:0/3298635708 >> v2:172.21.15.110:3300/0 conn(0x7fdef80382a0 msgr2=0x7fdef8038700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fdefeffd640 1 --2- 172.21.15.87:0/3298635708 >> v2:172.21.15.110:3300/0 conn(0x7fdef80382a0 0x7fdef8038700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fdefdffb640 1 -- 172.21.15.87:0/3298635708 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013007944 0 0) 0x7fdef8038c40 con 0x7fdef80cdbb0 2024-05-09T07:54:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fdefeffd640 1 -- 172.21.15.87:0/3298635708 >> v1:172.21.15.110:6789/0 conn(0x7fdef80cdbb0 legacy=0x7fdef80ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fdefeffd640 1 -- 172.21.15.87:0/3298635708 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef8039e30 con 0x7fdef8039a50 2024-05-09T07:54:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209819334 0 0) 0x7fad2c035430 con 0x7fad2c036b60 2024-05-09T07:54:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad20003520 con 0x7fad2c036b60 2024-05-09T07:54:46.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.296+0000 7f5c8ee7d640 1 -- start start 2024-05-09T07:54:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fdefe7fc640 1 --2- 172.21.15.87:0/3298635708 >> v2:172.21.15.110:3300/0 conn(0x7fdef80382a0 0x7fdef8038700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7f9951ffb640 1 -- 172.21.15.87:0/2067542003 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944004030 con 0x7f99540b45e0 2024-05-09T07:54:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2905503503 0 0) 0x7fad20003520 con 0x7fad2c036b60 2024-05-09T07:54:46.320 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7f9951ffb640 1 -- 172.21.15.87:0/2067542003 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99440041d0 con 0x7f99540b45e0 2024-05-09T07:54:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7f9f8d332640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b62d0 0x7f9f880b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7f9f8d332640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f88072fc0 con 0x7f9f880b6750 2024-05-09T07:54:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7f9f8d332640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f880af730 con 0x7f9f88068330 2024-05-09T07:54:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7f9f8d332640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9f88073330 con 0x7f9f880b62d0 2024-05-09T07:54:46.321 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7f54a3fff640 1 --2- 172.21.15.87:0/319705369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c006240 0x7f549c0c9200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5490009720 tx=0x7f549002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161d051d3e01eb5d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad2c0d1180 msgr2=0x7fad2c0d1610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T07:54:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad2c0d1180 0x7fad2c0d1610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.322 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 >> v2:172.21.15.87:3300/0 conn(0x7fad2c0ca690 msgr2=0x7fad2c0cab10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T07:54:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f9f867fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b62d0 0x7f9f880b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f9f877fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9f880b6750 0x7f9f8813d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43578/0 (socket says 172.21.15.87:43578) 2024-05-09T07:54:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f9f877fe640 1 -- 172.21.15.87:0/2240411000 learned_addr learned my addr 172.21.15.87:0/2240411000 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 --2- 172.21.15.87:0/3422138279 >> v2:172.21.15.87:3300/0 conn(0x7fad2c0ca690 0x7fad2c0cab10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.323 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fc3958f5640 1 -- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c003a80 msgr2=0x7fc37c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fc3958f5640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c003a80 0x7fc37c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fc3958f5640 1 -- 172.21.15.87:0/1285585922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc37c0051c0 msgr2=0x7fc37c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fc3958f5640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc37c0051c0 0x7fc37c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fc3958f5640 1 -- 172.21.15.87:0/1285585922 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c003520 con 0x7fc37c004800 2024-05-09T07:54:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.297+0000 7fc3968f7640 1 -- 172.21.15.87:0/1285585922 reap_dead start 2024-05-09T07:54:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c036f40 con 0x7fad2c036b60 2024-05-09T07:54:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7fad24001670 con 0x7fad2c036b60 2024-05-09T07:54:46.324 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 >> v1:172.21.15.110:6789/0 conn(0x7fad2c036b60 legacy=0x7fad2c0d4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad200039b0 0x7fad20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad20004800 0x7fad20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad200053c0 0x7fad2000b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c0d0cf0 con 0x7fad20004800 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c038380 con 0x7fad200039b0 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fad2000c2f0 con 0x7fad200053c0 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fae049ab640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fae000b6360 0x7fae0006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fae049ab640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae0006d400 con 0x7fae0014f5e0 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fae049ab640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae0006d6e0 con 0x7fae000b6b10 2024-05-09T07:54:46.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fae049ab640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fae00073190 con 0x7fae000b6360 2024-05-09T07:54:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fadfed9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fae000b6b10 0x7fae000b6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:51452/0 (socket says 172.21.15.87:51452) 2024-05-09T07:54:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fadfdd9b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fae000b6360 0x7fae0006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fadfed9d640 1 -- 172.21.15.87:0/4205665242 learned_addr learned my addr 172.21.15.87:0/4205665242 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad39883640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad200039b0 0x7fad20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad39082640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad20004800 0x7fad20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.326 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fad3a084640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad200053c0 0x7fad2000b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f54a37fe640 1 -- 172.21.15.87:0/319705369 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490037070 con 0x7f549c006240 2024-05-09T07:54:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f54a37fe640 1 -- 172.21.15.87:0/319705369 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549002abe0 con 0x7f549c006240 2024-05-09T07:54:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f54a37fe640 1 -- 172.21.15.87:0/319705369 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5498001670 con 0x7f549c006240 2024-05-09T07:54:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f5c8ee7d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5c800369c0 0x7f5c80035920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f5c8ee7d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c80036da0 0x7f5c800d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f5c8ee7d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c800387d0 con 0x7f5c800d1680 2024-05-09T07:54:46.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f5c8ee7d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5c800d0cb0 con 0x7f5c800369c0 2024-05-09T07:54:46.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f5c8ee7d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5c800d0960 con 0x7f5c80036da0 2024-05-09T07:54:46.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f995947d640 1 -- 172.21.15.87:0/2067542003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b45e0 msgr2=0x7f995414c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f995947d640 1 --2- 172.21.15.87:0/2067542003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b45e0 0x7f995414c300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9944009850 tx=0x7f994402a160 comp rx=0 tx=0).stop 2024-05-09T07:54:46.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f5c8e67c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5c800d1680 0x7f5c800ca690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:51460/0 (socket says 172.21.15.87:51460) 2024-05-09T07:54:46.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f5c8e67c640 1 -- 172.21.15.87:0/41274050 learned_addr learned my addr 172.21.15.87:0/41274050 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f9f867fc640 1 -- 172.21.15.87:0/2240411000 >> v1:172.21.15.110:6789/0 conn(0x7f9f88068330 legacy=0x7f9f880b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f9f867fc640 1 -- 172.21.15.87:0/2240411000 >> v1:172.21.15.87:6789/0 conn(0x7f9f880b6750 legacy=0x7f9f8813d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7f9f867fc640 1 -- 172.21.15.87:0/2240411000 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8813dfa0 con 0x7f9f880b62d0 2024-05-09T07:54:46.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fc3958f5640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc37c004c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc38c004f80 tx=0x7fc37c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=557d7d586d6be35f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f5c8d67a640 1 --2- 172.21.15.87:0/41274050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c80036da0 0x7f5c800d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.298+0000 7fadfd59a640 1 -- 172.21.15.87:0/4205665242 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578788610 0 0) 0x7fae0006d6e0 con 0x7fae000b6b10 2024-05-09T07:54:46.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fadfdd9b640 1 -- 172.21.15.87:0/4205665242 >> v1:172.21.15.110:6789/0 conn(0x7fae000b6b10 legacy=0x7fae000b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fadfdd9b640 1 -- 172.21.15.87:0/4205665242 >> v1:172.21.15.87:6789/0 conn(0x7fae0014f5e0 legacy=0x7fae0014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fadfdd9b640 1 -- 172.21.15.87:0/4205665242 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0006d9c0 con 0x7fae000b6360 2024-05-09T07:54:46.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fad39082640 1 -- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad200053c0 msgr2=0x7fad2000b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fad39082640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad200053c0 0x7fad2000b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fad39082640 1 -- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad200039b0 msgr2=0x7fad20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fad39082640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad200039b0 0x7fad20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fad39082640 1 -- 172.21.15.87:0/3422138279 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c036f40 con 0x7fad20004800 2024-05-09T07:54:46.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fad3a084640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad200053c0 0x7fad2000b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:46.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f995947d640 1 -- 172.21.15.87:0/2067542003 shutdown_connections 2024-05-09T07:54:46.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f995947d640 1 --2- 172.21.15.87:0/2067542003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b45e0 0x7f995414c300 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f995947d640 1 --2- 172.21.15.87:0/2067542003 >> v2:172.21.15.110:3300/0 conn(0x7f99540b57a0 0x7f9954145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f995947d640 1 -- 172.21.15.87:0/2067542003 >> 172.21.15.87:0/2067542003 conn(0x7f99540bd0e0 msgr2=0x7f99540bd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f5c8ce79640 1 -- 172.21.15.87:0/41274050 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3245415928 0 0) 0x7f5c800387d0 con 0x7f5c800d1680 2024-05-09T07:54:46.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c004ba0 con 0x7fc37c004800 2024-05-09T07:54:46.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc38c02f030 con 0x7fc37c004800 2024-05-09T07:54:46.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f5c8ce79640 1 -- 172.21.15.87:0/41274050 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c74003520 con 0x7f5c800d1680 2024-05-09T07:54:46.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7fc3950f4640 1 -- 172.21.15.87:0/1285585922 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c005d50 con 0x7fc37c004800 2024-05-09T07:54:46.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f5c8d67a640 1 -- 172.21.15.87:0/41274050 >> v2:172.21.15.87:3300/0 conn(0x7f5c800369c0 msgr2=0x7f5c80035920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f5c8d67a640 1 --2- 172.21.15.87:0/41274050 >> v2:172.21.15.87:3300/0 conn(0x7f5c800369c0 0x7f5c80035920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f5c8d67a640 1 -- 172.21.15.87:0/41274050 >> v1:172.21.15.110:6789/0 conn(0x7f5c800d1680 legacy=0x7f5c800ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f5c8d67a640 1 -- 172.21.15.87:0/41274050 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c80038170 con 0x7f5c80036da0 2024-05-09T07:54:46.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f9f867fc640 1 --2- 172.21.15.87:0/2240411000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b62d0 0x7f9f880b3fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009dc0 tx=0x7f9f8002a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1e9f9b2886b385f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f54a9e68640 1 -- 172.21.15.87:0/319705369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c006240 msgr2=0x7f549c0c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f54a9e68640 1 --2- 172.21.15.87:0/319705369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c006240 0x7f549c0c9200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5490009720 tx=0x7f549002a0d0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f9f85ffb640 1 -- 172.21.15.87:0/2240411000 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80007740 con 0x7f9f880b62d0 2024-05-09T07:54:46.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f54a9e68640 1 -- 172.21.15.87:0/319705369 shutdown_connections 2024-05-09T07:54:46.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f54a9e68640 1 --2- 172.21.15.87:0/319705369 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c006240 0x7f549c0c9200 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f54a9e68640 1 -- 172.21.15.87:0/319705369 >> 172.21.15.87:0/319705369 conn(0x7f549c03b130 msgr2=0x7f549c03b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fdefeffd640 1 --2- 172.21.15.87:0/3298635708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 0x7fdef8006cc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009f80 tx=0x7fdef002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8339722e5440760 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f54a9e68640 1 -- 172.21.15.87:0/319705369 shutdown_connections 2024-05-09T07:54:46.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fc39835a640 1 -- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 msgr2=0x7fc37c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fc39835a640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc37c004c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc38c004f80 tx=0x7fc37c005830 comp rx=0 tx=0).stop 2024-05-09T07:54:46.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fadfdd9b640 1 --2- 172.21.15.87:0/4205665242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae000b6360 0x7fae0006dee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fadf00097a0 tx=0x7fadf002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e169c8564a3485 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fc39835a640 1 -- 172.21.15.87:0/1285585922 shutdown_connections 2024-05-09T07:54:46.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fc39835a640 1 --2- 172.21.15.87:0/1285585922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc37c004c80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fc39835a640 1 -- 172.21.15.87:0/1285585922 >> 172.21.15.87:0/1285585922 conn(0x7fc390067670 msgr2=0x7fc39006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fad39082640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad20004800 0x7fad20004c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad30009800 tx=0x7fad20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac617883b4e147c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f9f85ffb640 1 -- 172.21.15.87:0/2240411000 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f800078e0 con 0x7f9f880b62d0 2024-05-09T07:54:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.299+0000 7f9f85ffb640 1 -- 172.21.15.87:0/2240411000 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80007cb0 con 0x7f9f880b62d0 2024-05-09T07:54:46.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f995947d640 1 -- 172.21.15.87:0/2067542003 shutdown_connections 2024-05-09T07:54:46.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f54a9e68640 1 -- 172.21.15.87:0/319705369 wait complete. 2024-05-09T07:54:46.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30037070 con 0x7fad20004800 2024-05-09T07:54:46.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f9f8d332640 1 -- 172.21.15.87:0/2240411000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b62d0 msgr2=0x7f9f880b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f5c8d67a640 1 --2- 172.21.15.87:0/41274050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c80036da0 0x7f5c800d1140 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c88000b60 tx=0x7f5c880a5d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6eada46cd98da77 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f9f8d332640 1 --2- 172.21.15.87:0/2240411000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b62d0 0x7f9f880b3fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009dc0 tx=0x7f9f8002a5b0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fc39835a640 1 -- 172.21.15.87:0/1285585922 shutdown_connections 2024-05-09T07:54:46.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fc39835a640 1 -- 172.21.15.87:0/1285585922 wait complete. 2024-05-09T07:54:46.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fdefdffb640 1 -- 172.21.15.87:0/3298635708 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0037070 con 0x7fdef8039a50 2024-05-09T07:54:46.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fdefdffb640 1 -- 172.21.15.87:0/3298635708 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef0032440 con 0x7fdef8039a50 2024-05-09T07:54:46.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7fdefdffb640 1 -- 172.21.15.87:0/3298635708 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0032810 con 0x7fdef8039a50 2024-05-09T07:54:46.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.300+0000 7f995947d640 1 -- 172.21.15.87:0/2067542003 wait complete. 2024-05-09T07:54:46.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7f9f8d332640 1 -- 172.21.15.87:0/2240411000 shutdown_connections 2024-05-09T07:54:46.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7f9f8d332640 1 --2- 172.21.15.87:0/2240411000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b62d0 0x7f9f880b3fb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7f9f8d332640 1 -- 172.21.15.87:0/2240411000 >> 172.21.15.87:0/2240411000 conn(0x7f9f880b96f0 msgr2=0x7f9f880b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7f9f8d332640 1 -- 172.21.15.87:0/2240411000 shutdown_connections 2024-05-09T07:54:46.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7f5c8ce79640 1 -- 172.21.15.87:0/41274050 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c880b3070 con 0x7f5c80036da0 2024-05-09T07:54:46.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7fad38881640 1 -- 172.21.15.87:0/3422138279 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3002aa10 con 0x7fad20004800 2024-05-09T07:54:46.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7f5c8ce79640 1 -- 172.21.15.87:0/41274050 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c880a6b50 con 0x7f5c80036da0 2024-05-09T07:54:46.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7fadfd59a640 1 -- 172.21.15.87:0/4205665242 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0037070 con 0x7fae000b6360 2024-05-09T07:54:46.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7fdefffff640 1 -- 172.21.15.87:0/3298635708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 msgr2=0x7fdef8006cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7fdefffff640 1 --2- 172.21.15.87:0/3298635708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 0x7fdef8006cc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009f80 tx=0x7fdef002a210 comp rx=0 tx=0).stop 2024-05-09T07:54:46.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7f9f8d332640 1 -- 172.21.15.87:0/2240411000 wait complete. 2024-05-09T07:54:46.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7fadfd59a640 1 -- 172.21.15.87:0/4205665242 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf0032440 con 0x7fae000b6360 2024-05-09T07:54:46.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7fadfd59a640 1 -- 172.21.15.87:0/4205665242 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0032810 con 0x7fae000b6360 2024-05-09T07:54:46.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fc39835a640 1 Processor -- start 2024-05-09T07:54:46.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f995947d640 1 Processor -- start 2024-05-09T07:54:46.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f5c8ee7d640 1 -- 172.21.15.87:0/41274050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c80036da0 msgr2=0x7f5c800d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f5c8ee7d640 1 --2- 172.21.15.87:0/41274050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c80036da0 0x7f5c800d1140 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c88000b60 tx=0x7f5c880a5d00 comp rx=0 tx=0).stop 2024-05-09T07:54:46.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f995947d640 1 -- start start 2024-05-09T07:54:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fad3a885640 1 -- 172.21.15.87:0/3422138279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad20004800 msgr2=0x7fad20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fad3a885640 1 --2- 172.21.15.87:0/3422138279 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad20004800 0x7fad20004c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad30009800 tx=0x7fad20005830 comp rx=0 tx=0).stop 2024-05-09T07:54:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fad3a084640 1 -- 172.21.15.87:0/3422138279 reap_dead start 2024-05-09T07:54:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f5c8ee7d640 1 -- 172.21.15.87:0/41274050 shutdown_connections 2024-05-09T07:54:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f5c8ee7d640 1 --2- 172.21.15.87:0/41274050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c80036da0 0x7f5c800d1140 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f5c8ee7d640 1 --2- 172.21.15.87:0/41274050 >> v2:172.21.15.87:3300/0 conn(0x7f5c800369c0 0x7f5c80035920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f5c8ee7d640 1 -- 172.21.15.87:0/41274050 >> 172.21.15.87:0/41274050 conn(0x7f5c8003acf0 msgr2=0x7f5c8003b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7fdefffff640 1 -- 172.21.15.87:0/3298635708 shutdown_connections 2024-05-09T07:54:46.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7fdefffff640 1 --2- 172.21.15.87:0/3298635708 >> v2:172.21.15.110:3300/0 conn(0x7fdef80382a0 0x7fdef8038700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fdefffff640 1 --2- 172.21.15.87:0/3298635708 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 0x7fdef8006cc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fdefffff640 1 -- 172.21.15.87:0/3298635708 >> 172.21.15.87:0/3298635708 conn(0x7fdef80061a0 msgr2=0x7fdef80065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.301+0000 7f54a9e68640 1 Processor -- start 2024-05-09T07:54:46.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f54a9e68640 1 -- start start 2024-05-09T07:54:46.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f5c8ee7d640 1 -- 172.21.15.87:0/41274050 shutdown_connections 2024-05-09T07:54:46.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fae049ab640 1 -- 172.21.15.87:0/4205665242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae000b6360 msgr2=0x7fae0006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fae049ab640 1 --2- 172.21.15.87:0/4205665242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae000b6360 0x7fae0006dee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fadf00097a0 tx=0x7fadf002a230 comp rx=0 tx=0).stop 2024-05-09T07:54:46.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fad3a885640 1 -- 172.21.15.87:0/3422138279 shutdown_connections 2024-05-09T07:54:46.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fad3a885640 1 -- 172.21.15.87:0/3422138279 >> 172.21.15.87:0/3422138279 conn(0x7fad2c03abf0 msgr2=0x7fad2c005e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f9f8d332640 1 Processor -- start 2024-05-09T07:54:46.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f995947d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99540b45e0 0x7f9954149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f995947d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99540b57a0 0x7f99541d30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f995947d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b5b80 0x7f99541d2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f995947d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f99541463a0 con 0x7f99540b57a0 2024-05-09T07:54:46.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f995947d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9954146220 con 0x7f99540b45e0 2024-05-09T07:54:46.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f995947d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9954146520 con 0x7f99540b5b80 2024-05-09T07:54:46.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f9f8d332640 1 -- start start 2024-05-09T07:54:46.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7f5c8ee7d640 1 -- 172.21.15.87:0/41274050 wait complete. 2024-05-09T07:54:46.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.302+0000 7fc39835a640 1 -- start start 2024-05-09T07:54:46.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc39835a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc3901410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f99527fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99540b57a0 0x7f99541d30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fad3a885640 1 -- 172.21.15.87:0/3422138279 shutdown_connections 2024-05-09T07:54:46.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fdefffff640 1 -- 172.21.15.87:0/3298635708 shutdown_connections 2024-05-09T07:54:46.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc39835a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39009d970 0x7fc3901444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f99527fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99540b57a0 0x7f99541d30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55602/0 (socket says 172.21.15.87:55602) 2024-05-09T07:54:46.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f99527fc640 1 -- 172.21.15.87:0/36337174 learned_addr learned my addr 172.21.15.87:0/36337174 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc39835a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3901e56b0 0x7fc3901e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc3960f6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc3901410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc3960f6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc3901410a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:37590/0 (socket says 172.21.15.87:37590) 2024-05-09T07:54:46.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f54a9e68640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c0066c0 0x7f549c0d5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f54a9e68640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549c037360 0x7f549c0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f54a9e68640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f549c0c7990 0x7f549c0b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f54a9e68640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f549c035810 con 0x7f549c0066c0 2024-05-09T07:54:46.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f54a9e68640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f549c035690 con 0x7f549c0c7990 2024-05-09T07:54:46.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f54a9e68640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f549c0c2cf0 con 0x7f549c037360 2024-05-09T07:54:46.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fdefffff640 1 -- 172.21.15.87:0/3298635708 wait complete. 2024-05-09T07:54:46.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc3960f6640 1 -- 172.21.15.87:0/3297231130 learned_addr learned my addr 172.21.15.87:0/3297231130 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc39835a640 1 -- 172.21.15.87:0/3297231130 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc39009b3c0 con 0x7fc39009d970 2024-05-09T07:54:46.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f99537fe640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b5b80 0x7f99541d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f54a8e66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c0066c0 0x7f549c0d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc3968f7640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3901e56b0 0x7fc3901e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f9952ffd640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99540b45e0 0x7f9954149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc3958f5640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39009d970 0x7fc3901444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc39835a640 1 -- 172.21.15.87:0/3297231130 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc39014b360 con 0x7fc37c004800 2024-05-09T07:54:46.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7fc39835a640 1 -- 172.21.15.87:0/3297231130 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc39009b540 con 0x7fc3901e56b0 2024-05-09T07:54:46.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f99527fc640 1 -- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b5b80 msgr2=0x7f99541d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f54a8e66640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c0066c0 0x7f549c0d5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55624/0 (socket says 172.21.15.87:55624) 2024-05-09T07:54:46.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f54a8e66640 1 -- 172.21.15.87:0/1181715345 learned_addr learned my addr 172.21.15.87:0/1181715345 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f99527fc640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b5b80 0x7f99541d2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f99527fc640 1 -- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99540b45e0 msgr2=0x7f9954149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f99527fc640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99540b45e0 0x7f9954149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f99527fc640 1 -- 172.21.15.87:0/36337174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9954149a80 con 0x7f99540b57a0 2024-05-09T07:54:46.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f54a9667640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f549c0c7990 0x7f549c0b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.303+0000 7f9f8d332640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f88068330 0x7f9f881e09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f8d332640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f880b62d0 0x7f9f880b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f8d332640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b6750 0x7f9f880b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f8d332640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9f880b4670 con 0x7f9f88068330 2024-05-09T07:54:46.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f8d332640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9f880b44f0 con 0x7f9f880b62d0 2024-05-09T07:54:46.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f8d332640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9f880b47f0 con 0x7f9f880b6750 2024-05-09T07:54:46.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f99537fe640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99540b5b80 0x7f99541d2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:46.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f99527fc640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99540b57a0 0x7f99541d30d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99440090b0 tx=0x7f99440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f5c8ee7d640 1 Processor -- start 2024-05-09T07:54:46.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9952ffd640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99540b45e0 0x7f9954149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fc3960f6640 1 -- 172.21.15.87:0/3297231130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3901e56b0 msgr2=0x7fc3901e5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f867fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f880b62d0 0x7f9f880b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f867fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f880b62d0 0x7f9f880b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:37604/0 (socket says 172.21.15.87:37604) 2024-05-09T07:54:46.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f867fc640 1 -- 172.21.15.87:0/2657469412 learned_addr learned my addr 172.21.15.87:0/2657469412 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fc3960f6640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3901e56b0 0x7fc3901e5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fc3960f6640 1 -- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39009d970 msgr2=0x7fc3901444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fc3960f6640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc39009d970 0x7fc3901444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fc3960f6640 1 -- 172.21.15.87:0/3297231130 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3901435c0 con 0x7fc37c004800 2024-05-09T07:54:46.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f54a3fff640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549c037360 0x7f549c0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f86ffd640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f88068330 0x7f9f881e09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fad3a885640 1 -- 172.21.15.87:0/3422138279 wait complete. 2024-05-09T07:54:46.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fae049ab640 1 -- 172.21.15.87:0/4205665242 shutdown_connections 2024-05-09T07:54:46.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fae049ab640 1 --2- 172.21.15.87:0/4205665242 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae000b6360 0x7fae0006dee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fae049ab640 1 -- 172.21.15.87:0/4205665242 >> 172.21.15.87:0/4205665242 conn(0x7fae000b7bc0 msgr2=0x7fae000b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f54a8e66640 1 -- 172.21.15.87:0/1181715345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549c037360 msgr2=0x7f549c0c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f5c8ee7d640 1 -- start start 2024-05-09T07:54:46.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f54a8e66640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549c037360 0x7f549c0c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f993b7fe640 1 -- 172.21.15.87:0/36337174 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944041070 con 0x7f99540b57a0 2024-05-09T07:54:46.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f54a8e66640 1 -- 172.21.15.87:0/1181715345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f549c0c7990 msgr2=0x7f549c0b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f54a8e66640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f549c0c7990 0x7f549c0b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f993b7fe640 1 -- 172.21.15.87:0/36337174 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9944003e50 con 0x7f99540b57a0 2024-05-09T07:54:46.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f993b7fe640 1 -- 172.21.15.87:0/36337174 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994403d640 con 0x7f99540b57a0 2024-05-09T07:54:46.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99541d3610 con 0x7f99540b57a0 2024-05-09T07:54:46.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f54a8e66640 1 -- 172.21.15.87:0/1181715345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549c16ab20 con 0x7f549c0066c0 2024-05-09T07:54:46.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fae049ab640 1 -- 172.21.15.87:0/4205665242 shutdown_connections 2024-05-09T07:54:46.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99541d3bc0 con 0x7f99540b57a0 2024-05-09T07:54:46.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7f9f86ffd640 1 -- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b6750 msgr2=0x7f9f880b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7f5c8ee7d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c800369c0 0x7f5c80166280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7f5c8ee7d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c80036da0 0x7f5c801574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7f5c8ee7d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c800d1680 0x7f5c800c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7fad3a885640 1 Processor -- start 2024-05-09T07:54:46.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7f5c8ee7d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5c800cada0 con 0x7f5c800369c0 2024-05-09T07:54:46.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fc3960f6640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc3901410a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc38000f5b0 tx=0x7fc38000fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7fc386ffd640 1 -- 172.21.15.87:0/3297231130 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380013810 con 0x7fc37c004800 2024-05-09T07:54:46.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7fc39835a640 1 -- 172.21.15.87:0/3297231130 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39009ddf0 con 0x7fc37c004800 2024-05-09T07:54:46.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7fc39835a640 1 -- 172.21.15.87:0/3297231130 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc39009e3a0 con 0x7fc37c004800 2024-05-09T07:54:46.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9934001030 con 0x7f99540b57a0 2024-05-09T07:54:46.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f5c8e67c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c800d1680 0x7f5c800c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f5c8e67c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c800d1680 0x7f5c800c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47610/0 (socket says 172.21.15.87:47610) 2024-05-09T07:54:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f5c8e67c640 1 -- 172.21.15.87:0/676268325 learned_addr learned my addr 172.21.15.87:0/676268325 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f5c8ee7d640 1 -- 172.21.15.87:0/676268325 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5c80035e60 con 0x7f5c80036da0 2024-05-09T07:54:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f54a8e66640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c0066c0 0x7f549c0d5b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f549800c780 tx=0x7f549800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f5c8ee7d640 1 -- 172.21.15.87:0/676268325 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5c800caf20 con 0x7f5c800d1680 2024-05-09T07:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7fdefffff640 1 Processor -- start 2024-05-09T07:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7fdefffff640 1 -- start start 2024-05-09T07:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fdefffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdef80382a0 0x7fdef80d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fdefffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 0x7fdef8169380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fdefffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef80cdbb0 0x7fdef800cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fdefffff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdef803a920 con 0x7fdef8039a50 2024-05-09T07:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fdefffff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdef803a7a0 con 0x7fdef80cdbb0 2024-05-09T07:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fdefffff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fdef8007200 con 0x7fdef80382a0 2024-05-09T07:54:46.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.304+0000 7fae049ab640 1 -- 172.21.15.87:0/4205665242 wait complete. 2024-05-09T07:54:46.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fc386ffd640 1 -- 172.21.15.87:0/3297231130 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc38001a070 con 0x7fc37c004800 2024-05-09T07:54:46.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f54a3fff640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549c037360 0x7f549c0c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:46.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fc386ffd640 1 -- 172.21.15.87:0/3297231130 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380013bb0 con 0x7fc37c004800 2024-05-09T07:54:46.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f54a9667640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f549c0c7990 0x7f549c0b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f5c8de7b640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c800369c0 0x7f5c80166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fae049ab640 1 Processor -- start 2024-05-09T07:54:46.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fae049ab640 1 -- start start 2024-05-09T07:54:46.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fc384ff9640 1 -- 172.21.15.87:0/3297231130 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc390068660 con 0x7fc37c004800 2024-05-09T07:54:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.305+0000 7fad3a885640 1 -- start start 2024-05-09T07:54:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fad3a885640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad20004800 0x7fad2c0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fad3a885640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad2c0cdf10 0x7fad2c0baed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fad3a885640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad2c0ce370 0x7fad2c0bb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fad3a885640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c034e00 con 0x7fad2c0cdf10 2024-05-09T07:54:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fad3a885640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c0d4c90 con 0x7fad2c0ce370 2024-05-09T07:54:46.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fad3a885640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fad2c034f80 con 0x7fad20004800 2024-05-09T07:54:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fdefe7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 0x7fdef8169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fdefe7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 0x7fdef8169380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55644/0 (socket says 172.21.15.87:55644) 2024-05-09T07:54:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7fdefe7fc640 1 -- 172.21.15.87:0/1461503450 learned_addr learned my addr 172.21.15.87:0/1461503450 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f5c8d67a640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c80036da0 0x7f5c801574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fdeff7fe640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef80cdbb0 0x7fdef800cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fad3a084640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad2c0ce370 0x7fad2c0bb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fad39082640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad2c0cdf10 0x7fad2c0baed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fdefeffd640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdef80382a0 0x7fdef80d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.306+0000 7f9f877fe640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b6750 0x7f9f880b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f5c8de7b640 1 -- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c800d1680 msgr2=0x7f5c800c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f5c8de7b640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c800d1680 0x7f5c800c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f5c8de7b640 1 -- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c80036da0 msgr2=0x7f5c801574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f5c8de7b640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c80036da0 0x7f5c801574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f5c8de7b640 1 -- 172.21.15.87:0/676268325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c80158900 con 0x7f5c800369c0 2024-05-09T07:54:46.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f54a17fa640 1 -- 172.21.15.87:0/1181715345 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5498018070 con 0x7f549c0066c0 2024-05-09T07:54:46.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fdefe7fc640 1 -- 172.21.15.87:0/1461503450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdef80382a0 msgr2=0x7fdef80d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fdefe7fc640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdef80382a0 0x7fdef80d0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fdefe7fc640 1 -- 172.21.15.87:0/1461503450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef80cdbb0 msgr2=0x7fdef800cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fdefe7fc640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef80cdbb0 0x7fdef800cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fdefe7fc640 1 -- 172.21.15.87:0/1461503450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef8038050 con 0x7fdef8039a50 2024-05-09T07:54:46.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f9f86ffd640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b6750 0x7f9f880b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f9f86ffd640 1 -- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f880b62d0 msgr2=0x7f9f880b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f9f86ffd640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f880b62d0 0x7f9f880b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f5c8de7b640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c800369c0 0x7f5c80166280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00b410 tx=0x7f5c7c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f9f86ffd640 1 -- 172.21.15.87:0/2657469412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8809cc90 con 0x7f9f88068330 2024-05-09T07:54:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f9f867fc640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f880b62d0 0x7f9f880b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:46.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f9f86ffd640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f88068330 0x7f9f881e09b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800c390 tx=0x7f9f7800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fdefe7fc640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 0x7fdef8169380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c7f0 tx=0x7fdef400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f9f877fe640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f880b6750 0x7f9f880b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fc386ffd640 1 -- 172.21.15.87:0/3297231130 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc380012070 con 0x7fc37c004800 2024-05-09T07:54:46.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fae049ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae000b6360 0x7fae001e1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fae049ab640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b6b10 0x7fae001e5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fae049ab640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae0014f5e0 0x7fae00141290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fae049ab640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fae001500d0 con 0x7fae000b6360 2024-05-09T07:54:46.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fae049ab640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fae001576b0 con 0x7fae0014f5e0 2024-05-09T07:54:46.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fae049ab640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fae001e4b00 con 0x7fae000b6b10 2024-05-09T07:54:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fadfdd9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b6b10 0x7fae001e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fadfdd9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b6b10 0x7fae001e5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47652/0 (socket says 172.21.15.87:47652) 2024-05-09T07:54:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fadfdd9b640 1 -- 172.21.15.87:0/2439922035 learned_addr learned my addr 172.21.15.87:0/2439922035 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fdee77fe640 1 -- 172.21.15.87:0/1461503450 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4015070 con 0x7fdef8039a50 2024-05-09T07:54:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fad3a084640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad2c0ce370 0x7fad2c0bb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:37628/0 (socket says 172.21.15.87:37628) 2024-05-09T07:54:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fad3a084640 1 -- 172.21.15.87:0/3935237252 learned_addr learned my addr 172.21.15.87:0/3935237252 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fad39082640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad2c0cdf10 0x7fad2c0baed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55654/0 (socket says 172.21.15.87:55654) 2024-05-09T07:54:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fad3a084640 1 -- 172.21.15.87:0/3935237252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad20004800 msgr2=0x7fad2c0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7fad39883640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad20004800 0x7fad2c0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fad3a084640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad20004800 0x7fad2c0cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fad3a084640 1 -- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad2c0cdf10 msgr2=0x7fad2c0baed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fad3a084640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad2c0cdf10 0x7fad2c0baed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7f9f6f7fe640 1 -- 172.21.15.87:0/2657469412 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78005220 con 0x7f9f88068330 2024-05-09T07:54:46.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fad3a084640 1 -- 172.21.15.87:0/3935237252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c0ccb60 con 0x7fad2c0ce370 2024-05-09T07:54:46.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fc386ffd640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc37406bf30 0x7fc37406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549c0c38b0 con 0x7f549c0066c0 2024-05-09T07:54:46.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549c0b74b0 con 0x7f549c0066c0 2024-05-09T07:54:46.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8809cf70 con 0x7f9f88068330 2024-05-09T07:54:46.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f880b09d0 con 0x7f9f88068330 2024-05-09T07:54:46.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7f9f6f7fe640 1 -- 172.21.15.87:0/2657469412 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f780053c0 con 0x7f9f88068330 2024-05-09T07:54:46.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7f9f6f7fe640 1 -- 172.21.15.87:0/2657469412 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f78007250 con 0x7f9f88068330 2024-05-09T07:54:46.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7f54a17fa640 1 -- 172.21.15.87:0/1181715345 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54980072d0 con 0x7f549c0066c0 2024-05-09T07:54:46.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fc3958f5640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc37406bf30 0x7fc37406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fadfdd9b640 1 -- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae0014f5e0 msgr2=0x7fae00141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fadfdd9b640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae0014f5e0 0x7fae00141290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f5c7a7fc640 1 -- 172.21.15.87:0/676268325 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c015020 con 0x7f5c800369c0 2024-05-09T07:54:46.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fadfdd9b640 1 -- 172.21.15.87:0/2439922035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae000b6360 msgr2=0x7fae001e1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7f54a17fa640 1 -- 172.21.15.87:0/1181715345 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54980047e0 con 0x7f549c0066c0 2024-05-09T07:54:46.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.307+0000 7f5c7a7fc640 1 -- 172.21.15.87:0/676268325 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7c011830 con 0x7f5c800369c0 2024-05-09T07:54:46.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7f5c8ee7d640 1 -- 172.21.15.87:0/676268325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c80158be0 con 0x7f5c800369c0 2024-05-09T07:54:46.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7f5c8ee7d640 1 -- 172.21.15.87:0/676268325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c800c7560 con 0x7f5c800369c0 2024-05-09T07:54:46.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7f5c7a7fc640 1 -- 172.21.15.87:0/676268325 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c015020 con 0x7f5c800369c0 2024-05-09T07:54:46.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fadfdd9b640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae000b6360 0x7fae001e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fadfdd9b640 1 -- 172.21.15.87:0/2439922035 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae001e4d50 con 0x7fae000b6b10 2024-05-09T07:54:46.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef80d4d50 con 0x7fdef8039a50 2024-05-09T07:54:46.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f549c0c3660 con 0x7f549c0066c0 2024-05-09T07:54:46.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef80d1620 con 0x7fdef8039a50 2024-05-09T07:54:46.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.308+0000 7fdee77fe640 1 -- 172.21.15.87:0/1461503450 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef4007820 con 0x7fdef8039a50 2024-05-09T07:54:46.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fdee77fe640 1 -- 172.21.15.87:0/1461503450 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4007bd0 con 0x7fdef8039a50 2024-05-09T07:54:46.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fadfdd9b640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b6b10 0x7fae001e5550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fadf002a820 tx=0x7fadf00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdee0001030 con 0x7fdef8039a50 2024-05-09T07:54:46.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fad39082640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad2c0cdf10 0x7fad2c0baed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:46.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fad3a084640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad2c0ce370 0x7fad2c0bb410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad3406a280 tx=0x7fad34068e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fad39883640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad20004800 0x7fad2c0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fadeeffd640 1 -- 172.21.15.87:0/2439922035 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0040020 con 0x7fae000b6b10 2024-05-09T07:54:46.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fadeeffd640 1 -- 172.21.15.87:0/2439922035 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf0038040 con 0x7fae000b6b10 2024-05-09T07:54:46.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fadeeffd640 1 -- 172.21.15.87:0/2439922035 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0037070 con 0x7fae000b6b10 2024-05-09T07:54:46.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.309+0000 7fad2a7fc640 1 -- 172.21.15.87:0/3935237252 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34094440 con 0x7fad2c0ce370 2024-05-09T07:54:46.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fad2a7fc640 1 -- 172.21.15.87:0/3935237252 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad340945e0 con 0x7fad2c0ce370 2024-05-09T07:54:46.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fad2a7fc640 1 -- 172.21.15.87:0/3935237252 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad340949d0 con 0x7fad2c0ce370 2024-05-09T07:54:46.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2c0a56e0 con 0x7fad2c0ce370 2024-05-09T07:54:46.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad2c0cbe80 con 0x7fad2c0ce370 2024-05-09T07:54:46.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fc386ffd640 1 -- 172.21.15.87:0/3297231130 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc38008ad60 con 0x7fc37c004800 2024-05-09T07:54:46.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7f5c6bfff640 1 -- 172.21.15.87:0/676268325 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c800057e0 con 0x7f5c800369c0 2024-05-09T07:54:46.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f68001030 con 0x7f9f88068330 2024-05-09T07:54:46.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fc3958f5640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc37406bf30 0x7fc37406e3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc38c033000 tx=0x7fc38c038040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae001e5030 con 0x7fae000b6b10 2024-05-09T07:54:46.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0014fa20 con 0x7fae000b6b10 2024-05-09T07:54:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fc386ffd640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7fc3740741b0 0x7fc3740765d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fc386ffd640 1 -- 172.21.15.87:0/3297231130 --> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc38001ae70 con 0x7fc3740741b0 2024-05-09T07:54:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fc386ffd640 1 -- 172.21.15.87:0/3297231130 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc38008d3c0 con 0x7fc37c004800 2024-05-09T07:54:46.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7fdee77fe640 1 -- 172.21.15.87:0/1461503450 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdef4018070 con 0x7fdef8039a50 2024-05-09T07:54:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7f993b7fe640 1 -- 172.21.15.87:0/36337174 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99440040f0 con 0x7f99540b57a0 2024-05-09T07:54:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.311+0000 7fc3968f7640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7fc3740741b0 0x7fc3740765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad1c001030 con 0x7fad2c0ce370 2024-05-09T07:54:46.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7f54a17fa640 1 -- 172.21.15.87:0/1181715345 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f549801b070 con 0x7f549c0066c0 2024-05-09T07:54:46.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.310+0000 7f993b7fe640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f994006bf30 0x7f994006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7fc3968f7640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7fc3740741b0 0x7fc3740765d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.311+0000 7f993b7fe640 1 -- 172.21.15.87:0/36337174 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f99440abc80 con 0x7f99540b57a0 2024-05-09T07:54:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.311+0000 7f993b7fe640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7f9940074130 0x7f9940076550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.311+0000 7f993b7fe640 1 -- 172.21.15.87:0/36337174 --> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f994402be50 con 0x7f9940074130 2024-05-09T07:54:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7f9952ffd640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f994006bf30 0x7f994006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.311+0000 7fdee77fe640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdeec06be30 0x7fdeec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.311+0000 7fdefeffd640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdeec06be30 0x7fdeec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.311+0000 7fdee77fe640 1 -- 172.21.15.87:0/1461503450 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdef408b460 con 0x7fdef8039a50 2024-05-09T07:54:46.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7fdefeffd640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdeec06be30 0x7fdeec06e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdef0034000 tx=0x7fdef002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7fdee77fe640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7fdeec074030 0x7fdeec076450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7fdee77fe640 1 -- 172.21.15.87:0/1461503450 --> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdeec076b00 con 0x7fdeec074030 2024-05-09T07:54:46.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7f99537fe640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7f9940074130 0x7f9940076550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7fdeff7fe640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7fdeec074030 0x7fdeec076450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7f54a17fa640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f548806bf00 0x7f548806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.312+0000 7f99537fe640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7f9940074130 0x7f9940076550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f9952ffd640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f994006bf30 0x7f994006e3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9948006fd0 tx=0x7f9948008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f54a17fa640 1 -- 172.21.15.87:0/1181715345 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f549808ab20 con 0x7f549c0066c0 2024-05-09T07:54:46.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7fad2a7fc640 1 -- 172.21.15.87:0/3935237252 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad34094b70 con 0x7fad2c0ce370 2024-05-09T07:54:46.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f54a17fa640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f5488074120 0x7f5488076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f9f6f7fe640 1 -- 172.21.15.87:0/2657469412 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f78019020 con 0x7f9f88068330 2024-05-09T07:54:46.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f54a3fff640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f548806bf00 0x7f548806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f54a17fa640 1 -- 172.21.15.87:0/1181715345 --> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5488076bf0 con 0x7f5488074120 2024-05-09T07:54:46.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f54a17fa640 1 -- 172.21.15.87:0/1181715345 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f549808af10 con 0x7f549c0066c0 2024-05-09T07:54:46.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7fdeff7fe640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7fdeec074030 0x7fdeec076450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f54a9667640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f5488074120 0x7f5488076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7fc386ffd640 1 -- 172.21.15.87:0/3297231130 <== osd.0 v2:172.21.15.87:6800/1946784247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc38001ae70 con 0x7fc3740741b0 2024-05-09T07:54:46.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae000691f0 con 0x7fae000b6b10 2024-05-09T07:54:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7fad2a7fc640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fad1806be80 0x7fad1806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f993b7fe640 1 -- 172.21.15.87:0/36337174 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9944076240 con 0x7f99540b57a0 2024-05-09T07:54:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f993b7fe640 1 -- 172.21.15.87:0/36337174 <== osd.6 v2:172.21.15.110:6808/1772840831 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f994402be50 con 0x7f9940074130 2024-05-09T07:54:46.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f5c7a7fc640 1 -- 172.21.15.87:0/676268325 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c7c018020 con 0x7f5c800369c0 2024-05-09T07:54:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f9f6f7fe640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9f7406be60 0x7f9f7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7f54a3fff640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f548806bf00 0x7f548806e3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5490034000 tx=0x7f549002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f5c7a7fc640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5c6c06c230 0x7f5c6c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f54a9667640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f5488074120 0x7f5488076540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f9f867fc640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9f7406be60 0x7f9f7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f9f6f7fe640 1 -- 172.21.15.87:0/2657469412 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f7808a7b0 con 0x7f9f88068330 2024-05-09T07:54:46.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7fad2a7fc640 1 -- 172.21.15.87:0/3935237252 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad34106a00 con 0x7fad2c0ce370 2024-05-09T07:54:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f5c7a7fc640 1 -- 172.21.15.87:0/676268325 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c7c011630 con 0x7f5c800369c0 2024-05-09T07:54:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f9f6f7fe640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7f9f740740e0 0x7f9f74076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f9f6f7fe640 1 -- 172.21.15.87:0/2657469412 --> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f74076bb0 con 0x7f9f740740e0 2024-05-09T07:54:46.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f9f6f7fe640 1 -- 172.21.15.87:0/2657469412 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9f7808aba0 con 0x7f9f88068330 2024-05-09T07:54:46.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7fad2a7fc640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7fad18074100 0x7fad18076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7fad2a7fc640 1 -- 172.21.15.87:0/3935237252 --> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad18076bd0 con 0x7fad18074100 2024-05-09T07:54:46.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7fad2a7fc640 1 -- 172.21.15.87:0/3935237252 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fad3410b2a0 con 0x7fad2c0ce370 2024-05-09T07:54:46.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f5c7a7fc640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7f5c6c074f50 0x7f5c6c0773f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.313+0000 7fdee77fe640 1 -- 172.21.15.87:0/1461503450 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdef4055a50 con 0x7fdef8039a50 2024-05-09T07:54:46.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f5c7a7fc640 1 -- 172.21.15.87:0/676268325 --> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c6c077ac0 con 0x7f5c6c074f50 2024-05-09T07:54:46.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7fdee77fe640 1 -- 172.21.15.87:0/1461503450 <== osd.2 v2:172.21.15.87:6816/2336174143 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdeec076b00 con 0x7fdeec074030 2024-05-09T07:54:46.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f5c7a7fc640 1 -- 172.21.15.87:0/676268325 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5c7c0558a0 con 0x7f5c800369c0 2024-05-09T07:54:46.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f5c8d67a640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5c6c06c230 0x7f5c6c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7f9f877fe640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7f9f740740e0 0x7f9f74076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.314+0000 7fad39082640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7fad18074100 0x7fad18076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.315+0000 7f5c8e67c640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7f5c6c074f50 0x7f5c6c0773f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.315+0000 7f9f867fc640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9f7406be60 0x7f9f7406e320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009bd0 tx=0x7f9f8002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.315+0000 7fad39883640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fad1806be80 0x7fad1806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.315+0000 7f54a17fa640 1 -- 172.21.15.87:0/1181715345 <== osd.1 v2:172.21.15.87:6808/2730159651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5488076bf0 con 0x7f5488074120 2024-05-09T07:54:46.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.315+0000 7f9f877fe640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7f9f740740e0 0x7f9f74076500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.315+0000 7fad39082640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7fad18074100 0x7fad18076520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.315+0000 7f5c8e67c640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7f5c6c074f50 0x7f5c6c0773f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.316+0000 7f5c8d67a640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5c6c06c230 0x7f5c6c06e6f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c800d0e30 tx=0x7f5c880aa000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.315+0000 7fadeeffd640 1 -- 172.21.15.87:0/2439922035 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadf0043020 con 0x7fae000b6b10 2024-05-09T07:54:46.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.315+0000 7fad39883640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fad1806be80 0x7fad1806e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fad24000fb0 tx=0x7fad24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.316+0000 7f9f6f7fe640 1 -- 172.21.15.87:0/2657469412 <== osd.7 v2:172.21.15.110:6816/628113560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f74076bb0 con 0x7f9f740740e0 2024-05-09T07:54:46.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.316+0000 7fad2a7fc640 1 -- 172.21.15.87:0/3935237252 <== osd.3 v2:172.21.15.87:6824/61362060 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad18076bd0 con 0x7fad18074100 2024-05-09T07:54:46.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.316+0000 7f5c7a7fc640 1 -- 172.21.15.87:0/676268325 <== osd.4 v2:172.21.15.110:6823/1484209221 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c6c077ac0 con 0x7f5c6c074f50 2024-05-09T07:54:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.316+0000 7fadeeffd640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fade006bf00 0x7fade006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.316+0000 7fadeeffd640 1 -- 172.21.15.87:0/2439922035 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fadf00ab480 con 0x7fae000b6b10 2024-05-09T07:54:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.316+0000 7fadfe59c640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fade006bf00 0x7fade006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.318+0000 7fadfe59c640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fade006bf00 0x7fade006e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae0006fb60 tx=0x7fadf4007970 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.318+0000 7fadeeffd640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7fade0074180 0x7fade00765a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.318+0000 7fadeeffd640 1 -- 172.21.15.87:0/2439922035 --> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fadf0042e70 con 0x7fade0074180 2024-05-09T07:54:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.318+0000 7fadeeffd640 1 -- 172.21.15.87:0/2439922035 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fadf00b2050 con 0x7fae000b6b10 2024-05-09T07:54:46.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.319+0000 7fadfed9d640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7fade0074180 0x7fade00765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.320+0000 7fadfed9d640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7fade0074180 0x7fade00765a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.321+0000 7fadeeffd640 1 -- 172.21.15.87:0/2439922035 <== osd.5 v2:172.21.15.110:6800/1937011744 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fadf0042e70 con 0x7fade0074180 2024-05-09T07:54:46.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.344+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 --> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad1c002dd0 con 0x7fad18074100 2024-05-09T07:54:46.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.344+0000 7fad2a7fc640 1 -- 172.21.15.87:0/3935237252 <== osd.3 v2:172.21.15.87:6824/61362060 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fad1c002dd0 con 0x7fad18074100 2024-05-09T07:54:46.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.345+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7fad18074100 msgr2=0x7fad18076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.345+0000 7fad3a885640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7fad18074100 0x7fad18076520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.345+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fad1806be80 msgr2=0x7fad1806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.345+0000 7fad3a885640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fad1806be80 0x7fad1806e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fad24000fb0 tx=0x7fad24009040 comp rx=0 tx=0).stop 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.346+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad2c0ce370 msgr2=0x7fad2c0bb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.346+0000 7fad3a885640 1 --2- 172.21.15.87:0/3935237252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad2c0ce370 0x7fad2c0bb410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad3406a280 tx=0x7fad34068e10 comp rx=0 tx=0).stop 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.346+0000 7fad3a084640 1 -- 172.21.15.87:0/3935237252 reap_dead start 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.346+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 shutdown_connections 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.346+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 >> 172.21.15.87:0/3935237252 conn(0x7fad2c03abf0 msgr2=0x7fad2c0055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.346+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 shutdown_connections 2024-05-09T07:54:46.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.346+0000 7fad3a885640 1 -- 172.21.15.87:0/3935237252 wait complete. 2024-05-09T07:54:46.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.346+0000 7fc384ff9640 1 -- 172.21.15.87:0/3297231130 --> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3900691f0 con 0x7fc3740741b0 2024-05-09T07:54:46.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.347+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 --> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdee0002dd0 con 0x7fdeec074030 2024-05-09T07:54:46.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.347+0000 7fc386ffd640 1 -- 172.21.15.87:0/3297231130 <== osd.0 v2:172.21.15.87:6800/1946784247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc3900691f0 con 0x7fc3740741b0 2024-05-09T07:54:46.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7fc384ff9640 1 -- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7fc3740741b0 msgr2=0x7fc3740765d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7fc384ff9640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7fc3740741b0 0x7fc3740765d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.347+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 --> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f549c0057e0 con 0x7f5488074120 2024-05-09T07:54:46.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.347+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 --> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9934002dd0 con 0x7f9940074130 2024-05-09T07:54:46.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7fc384ff9640 1 -- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc37406bf30 msgr2=0x7fc37406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7fc384ff9640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc37406bf30 0x7fc37406e3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc38c033000 tx=0x7fc38c038040 comp rx=0 tx=0).stop 2024-05-09T07:54:46.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7fc384ff9640 1 -- 172.21.15.87:0/3297231130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 msgr2=0x7fc3901410a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7fc384ff9640 1 --2- 172.21.15.87:0/3297231130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004800 0x7fc3901410a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc38000f5b0 tx=0x7fc38000fa70 comp rx=0 tx=0).stop 2024-05-09T07:54:46.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7fc3968f7640 1 -- 172.21.15.87:0/3297231130 reap_dead start 2024-05-09T07:54:46.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7f54a17fa640 1 -- 172.21.15.87:0/1181715345 <== osd.1 v2:172.21.15.87:6808/2730159651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f549c0057e0 con 0x7f5488074120 2024-05-09T07:54:46.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7fdee77fe640 1 -- 172.21.15.87:0/1461503450 <== osd.2 v2:172.21.15.87:6816/2336174143 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdee0002dd0 con 0x7fdeec074030 2024-05-09T07:54:46.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7f993b7fe640 1 -- 172.21.15.87:0/36337174 <== osd.6 v2:172.21.15.110:6808/1772840831 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9934002dd0 con 0x7f9940074130 2024-05-09T07:54:46.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7fc384ff9640 1 -- 172.21.15.87:0/3297231130 shutdown_connections 2024-05-09T07:54:46.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fc384ff9640 1 -- 172.21.15.87:0/3297231130 >> 172.21.15.87:0/3297231130 conn(0x7fc390067670 msgr2=0x7fc390148270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f5488074120 msgr2=0x7f5488076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f5488074120 0x7f5488076540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7f9940074130 msgr2=0x7f9940076550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.348+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 --> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9f68002dd0 con 0x7f9f740740e0 2024-05-09T07:54:46.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f995947d640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7f9940074130 0x7f9940076550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7fdeec074030 msgr2=0x7fdeec076450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7fdeec074030 0x7fdeec076450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f994006bf30 msgr2=0x7f994006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f995947d640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f994006bf30 0x7f994006e3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9948006fd0 tx=0x7f9948008040 comp rx=0 tx=0).stop 2024-05-09T07:54:46.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fc384ff9640 1 -- 172.21.15.87:0/3297231130 shutdown_connections 2024-05-09T07:54:46.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f548806bf00 msgr2=0x7f548806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f548806bf00 0x7f548806e3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5490034000 tx=0x7f549002e000 comp rx=0 tx=0).stop 2024-05-09T07:54:46.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c0066c0 msgr2=0x7f549c0d5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 --2- 172.21.15.87:0/1181715345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f549c0066c0 0x7f549c0d5b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f549800c780 tx=0x7f549800cc40 comp rx=0 tx=0).stop 2024-05-09T07:54:46.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9667640 1 -- 172.21.15.87:0/1181715345 reap_dead start 2024-05-09T07:54:46.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 shutdown_connections 2024-05-09T07:54:46.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 >> 172.21.15.87:0/1181715345 conn(0x7f549c03b130 msgr2=0x7f549c03c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 shutdown_connections 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f54a9e68640 1 -- 172.21.15.87:0/1181715345 wait complete. 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdeec06be30 msgr2=0x7fdeec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdeec06be30 0x7fdeec06e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdef0034000 tx=0x7fdef002e000 comp rx=0 tx=0).stop 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 msgr2=0x7fdef8169380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 --2- 172.21.15.87:0/1461503450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef8039a50 0x7fdef8169380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c7f0 tx=0x7fdef400ccb0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdeff7fe640 1 -- 172.21.15.87:0/1461503450 reap_dead start 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 shutdown_connections 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 >> 172.21.15.87:0/1461503450 conn(0x7fdef80061a0 msgr2=0x7fdef8006580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 shutdown_connections 2024-05-09T07:54:46.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7fdefffff640 1 -- 172.21.15.87:0/1461503450 wait complete. 2024-05-09T07:54:46.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99540b57a0 msgr2=0x7f99541d30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f995947d640 1 --2- 172.21.15.87:0/36337174 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f99540b57a0 0x7f99541d30d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f99440090b0 tx=0x7f99440046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f99537fe640 1 -- 172.21.15.87:0/36337174 reap_dead start 2024-05-09T07:54:46.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 shutdown_connections 2024-05-09T07:54:46.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 >> 172.21.15.87:0/36337174 conn(0x7f99540bd0e0 msgr2=0x7f995414c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f9f6f7fe640 1 -- 172.21.15.87:0/2657469412 <== osd.7 v2:172.21.15.110:6816/628113560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9f68002dd0 con 0x7f9f740740e0 2024-05-09T07:54:46.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.349+0000 7f5c6bfff640 1 -- 172.21.15.87:0/676268325 --> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c80156d10 con 0x7f5c6c074f50 2024-05-09T07:54:46.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7f9f740740e0 msgr2=0x7f9f74076500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 shutdown_connections 2024-05-09T07:54:46.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7f9f740740e0 0x7f9f74076500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7fc384ff9640 1 -- 172.21.15.87:0/3297231130 wait complete. 2024-05-09T07:54:46.423 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f995947d640 1 -- 172.21.15.87:0/36337174 wait complete. 2024-05-09T07:54:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9f7406be60 msgr2=0x7f9f7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9f7406be60 0x7f9f7406e320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009bd0 tx=0x7f9f8002f000 comp rx=0 tx=0).stop 2024-05-09T07:54:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f88068330 msgr2=0x7f9f881e09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 --2- 172.21.15.87:0/2657469412 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9f88068330 0x7f9f881e09b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800c390 tx=0x7f9f7800c850 comp rx=0 tx=0).stop 2024-05-09T07:54:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f877fe640 1 -- 172.21.15.87:0/2657469412 reap_dead start 2024-05-09T07:54:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 shutdown_connections 2024-05-09T07:54:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 >> 172.21.15.87:0/2657469412 conn(0x7f9f880b96f0 msgr2=0x7f9f880b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.424 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f5c7a7fc640 1 -- 172.21.15.87:0/676268325 <== osd.4 v2:172.21.15.110:6823/1484209221 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5c80156d10 con 0x7f5c6c074f50 2024-05-09T07:54:46.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 shutdown_connections 2024-05-09T07:54:46.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.350+0000 7f9f8d332640 1 -- 172.21.15.87:0/2657469412 wait complete. 2024-05-09T07:54:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7f5c6bfff640 1 -- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7f5c6c074f50 msgr2=0x7f5c6c0773f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7f5c6bfff640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7f5c6c074f50 0x7f5c6c0773f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7f5c6bfff640 1 -- 172.21.15.87:0/676268325 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5c6c06c230 msgr2=0x7f5c6c06e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7f5c6bfff640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5c6c06c230 0x7f5c6c06e6f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c800d0e30 tx=0x7f5c880aa000 comp rx=0 tx=0).stop 2024-05-09T07:54:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7f5c6bfff640 1 -- 172.21.15.87:0/676268325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c800369c0 msgr2=0x7f5c80166280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7f5c6bfff640 1 --2- 172.21.15.87:0/676268325 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5c800369c0 0x7f5c80166280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00b410 tx=0x7f5c7c00b8d0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7f5c8e67c640 1 -- 172.21.15.87:0/676268325 reap_dead start 2024-05-09T07:54:46.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7f5c6bfff640 1 -- 172.21.15.87:0/676268325 shutdown_connections 2024-05-09T07:54:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7f5c6bfff640 1 -- 172.21.15.87:0/676268325 >> 172.21.15.87:0/676268325 conn(0x7f5c8003acf0 msgr2=0x7f5c800059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.351+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 --> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae000ba200 con 0x7fade0074180 2024-05-09T07:54:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.352+0000 7f5c6bfff640 1 -- 172.21.15.87:0/676268325 shutdown_connections 2024-05-09T07:54:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.352+0000 7f5c6bfff640 1 -- 172.21.15.87:0/676268325 wait complete. 2024-05-09T07:54:46.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.354+0000 7fadeeffd640 1 -- 172.21.15.87:0/2439922035 <== osd.5 v2:172.21.15.110:6800/1937011744 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae000ba200 con 0x7fade0074180 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.354+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7fade0074180 msgr2=0x7fade00765a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fae049ab640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7fade0074180 0x7fade00765a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fade006bf00 msgr2=0x7fade006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fae049ab640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fade006bf00 0x7fade006e3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae0006fb60 tx=0x7fadf4007970 comp rx=0 tx=0).stop 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b6b10 msgr2=0x7fae001e5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fae049ab640 1 --2- 172.21.15.87:0/2439922035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b6b10 0x7fae001e5550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fadf002a820 tx=0x7fadf00046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fadfed9d640 1 -- 172.21.15.87:0/2439922035 reap_dead start 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 shutdown_connections 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 >> 172.21.15.87:0/2439922035 conn(0x7fae000b7bc0 msgr2=0x7fae0013da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 shutdown_connections 2024-05-09T07:54:46.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.355+0000 7fae049ab640 1 -- 172.21.15.87:0/2439922035 wait complete. 2024-05-09T07:54:46.430 INFO:teuthology.orchestra.run.smithi087.stdout:55834574856 2024-05-09T07:54:46.431 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T07:54:46.432 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-05-09T07:54:46.432 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T07:54:46.433 INFO:teuthology.orchestra.run.smithi087.stdout:60129542152 2024-05-09T07:54:46.433 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T07:54:46.434 INFO:teuthology.orchestra.run.smithi087.stdout:60129542152 2024-05-09T07:54:46.434 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T07:54:46.435 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-05-09T07:54:46.436 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T07:54:46.436 INFO:teuthology.orchestra.run.smithi087.stdout:55834574854 2024-05-09T07:54:46.437 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T07:54:46.438 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-05-09T07:54:46.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T07:54:46.439 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-05-09T07:54:46.439 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T07:54:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.626+0000 7f1a3ffb7640 1 Processor -- start 2024-05-09T07:54:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.627+0000 7f1a3ffb7640 1 -- start start 2024-05-09T07:54:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.627+0000 7f1a3ffb7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380add80 0x7f1a3806c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.642 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3ffb7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a3808ba70 0x7f1a380b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3ffb7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a380ae5a0 con 0x7f1a380b39d0 2024-05-09T07:54:46.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3ffb7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1a380b5350 con 0x7f1a3808ba70 2024-05-09T07:54:46.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3ffb7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1a380b4ab0 con 0x7f1a380add80 2024-05-09T07:54:46.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3e554640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1a380b39d0 0x7f1a38157a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43594/0 (socket says 172.21.15.87:43594) 2024-05-09T07:54:46.643 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3e554640 1 -- 172.21.15.87:0/3400138967 learned_addr learned my addr 172.21.15.87:0/3400138967 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3d552640 1 --2- 172.21.15.87:0/3400138967 >> v2:172.21.15.87:3300/0 conn(0x7f1a3808ba70 0x7f1a380b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3dd53640 1 --2- 172.21.15.87:0/3400138967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380add80 0x7f1a3806c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3d552640 1 -- 172.21.15.87:0/3400138967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380add80 msgr2=0x7f1a3806c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3d552640 1 --2- 172.21.15.87:0/3400138967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380add80 0x7f1a3806c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3d552640 1 -- 172.21.15.87:0/3400138967 >> v1:172.21.15.87:6789/0 conn(0x7f1a380b39d0 legacy=0x7f1a38157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3d552640 1 -- 172.21.15.87:0/3400138967 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a380b0410 con 0x7f1a3808ba70 2024-05-09T07:54:46.644 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.628+0000 7f1a3dd53640 1 --2- 172.21.15.87:0/3400138967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380add80 0x7f1a3806c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.629+0000 7f3d0e8f8640 1 Processor -- start 2024-05-09T07:54:46.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.629+0000 7f1dd7fff640 1 Processor -- start 2024-05-09T07:54:46.645 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.629+0000 7f3d0e8f8640 1 -- start start 2024-05-09T07:54:46.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.629+0000 7f1a3d552640 1 --2- 172.21.15.87:0/3400138967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3808ba70 0x7f1a380b3490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a380b4c30 tx=0x7f1a28029fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0ff2f199f1e6b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1a3cd51640 1 -- 172.21.15.87:0/3400138967 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28037070 con 0x7f1a3808ba70 2024-05-09T07:54:46.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1a3cd51640 1 -- 172.21.15.87:0/3400138967 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2802ac70 con 0x7f1a3808ba70 2024-05-09T07:54:46.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1a3cd51640 1 -- 172.21.15.87:0/3400138967 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28032660 con 0x7f1a3808ba70 2024-05-09T07:54:46.646 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f3d0e8f8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00006d20 0x7f3d000387a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.629+0000 7f1dd7fff640 1 -- start start 2024-05-09T07:54:46.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1dd7fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1dd809dd10 0x7f1dd8146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1dd7fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1dd81470f0 0x7f1dd814df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1dd7fff640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd80ae990 con 0x7f1dd80b4560 2024-05-09T07:54:46.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1dd7fff640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1dd80b30a0 con 0x7f1dd809dd10 2024-05-09T07:54:46.647 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1dd7fff640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f1dd80ae190 con 0x7f1dd81470f0 2024-05-09T07:54:46.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f3d0e8f8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d0003b130 0x7f3d00039490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.648 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f3d0e8f8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3d00038ce0 0x7f3d000399d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f3d0e8f8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f3d00036430 con 0x7f3d00038ce0 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f3d0e8f8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3d00036ef0 con 0x7f3d0003b130 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f3d0e8f8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3d00038180 con 0x7f3d00006d20 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f3d0e0f7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3d00038ce0 0x7f3d000399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f3d0e0f7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3d00038ce0 0x7f3d000399d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55684/0 (socket says 172.21.15.87:55684) 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1dd6ffd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1dd80b4560 0x7f1dd80b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:51468/0 (socket says 172.21.15.87:51468) 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/3155557831 learned_addr learned my addr 172.21.15.87:0/3155557831 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f1dd67fc640 1 --2- 172.21.15.87:0/3155557831 >> v2:172.21.15.87:3300/0 conn(0x7f1dd809dd10 0x7f1dd8146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568936709 0 0) 0x7f1dd80ae990 con 0x7f1dd80b4560 2024-05-09T07:54:46.649 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dc0007930 con 0x7f1dd80b4560 2024-05-09T07:54:46.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd77fe640 1 --2- 172.21.15.87:0/3155557831 >> v2:172.21.15.110:3300/0 conn(0x7f1dd81470f0 0x7f1dd814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7fcea6f3b640 1 Processor -- start 2024-05-09T07:54:46.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7fcea6f3b640 1 -- start start 2024-05-09T07:54:46.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3407368762 0 0) 0x7f1dc0007930 con 0x7f1dd80b4560 2024-05-09T07:54:46.650 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 >> v2:172.21.15.110:3300/0 conn(0x7f1dd81470f0 msgr2=0x7f1dd814df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 --2- 172.21.15.87:0/3155557831 >> v2:172.21.15.110:3300/0 conn(0x7f1dd81470f0 0x7f1dd814df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 >> v2:172.21.15.87:3300/0 conn(0x7f1dd809dd10 msgr2=0x7f1dd8146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 --2- 172.21.15.87:0/3155557831 >> v2:172.21.15.87:3300/0 conn(0x7f1dd809dd10 0x7f1dd8146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd80ae470 con 0x7f1dd80b4560 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f1dcc004e60 con 0x7f1dd80b4560 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 >> v1:172.21.15.110:6789/0 conn(0x7f1dd80b4560 legacy=0x7f1dd80b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 0x7f1dc00081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dc0008c10 0x7f1dc0009090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc0007460 0x7f1dc00095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd80b30a0 con 0x7f1dc0008c10 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd80ae190 con 0x7f1dc0007460 2024-05-09T07:54:46.651 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc0009e50 con 0x7f1dc0007dc0 2024-05-09T07:54:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f48d91dd640 1 Processor -- start 2024-05-09T07:54:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/3400138967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3808ba70 msgr2=0x7f1a380b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1a3ffb7640 1 --2- 172.21.15.87:0/3400138967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3808ba70 0x7f1a380b3490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a380b4c30 tx=0x7f1a28029fe0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.652 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f983e8bd640 1 Processor -- start 2024-05-09T07:54:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f1dd6ffd640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 0x7f1dc00081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1dd77fe640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc0007460 0x7f1dc00095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1dd67fc640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dc0008c10 0x7f1dc0009090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f48d91dd640 1 -- start start 2024-05-09T07:54:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.631+0000 7f3d0e0f7640 1 -- 172.21.15.87:0/653253238 learned_addr learned my addr 172.21.15.87:0/653253238 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.630+0000 7f3d0d0f5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d0003b130 0x7f3d00039490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.653 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f3d0d8f6640 1 --2- 172.21.15.87:0/653253238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00006d20 0x7f3d000387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f983e8bd640 1 -- start start 2024-05-09T07:54:46.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/3400138967 shutdown_connections 2024-05-09T07:54:46.654 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1a3ffb7640 1 --2- 172.21.15.87:0/3400138967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3808ba70 0x7f1a380b3490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc0007460 msgr2=0x7f1dc00095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1dd6ffd640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc0007460 0x7f1dc00095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.655 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1a3ffb7640 1 --2- 172.21.15.87:0/3400138967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380add80 0x7f1a3806c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/3400138967 >> 172.21.15.87:0/3400138967 conn(0x7f1a380b5590 msgr2=0x7f1a380b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7fcea6f3b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea00b0010 0x7fcea013e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.656 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7fcea6f3b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcea006d130 0x7fcea013e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7fcea6f3b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea006d950 con 0x7fcea01444b0 2024-05-09T07:54:46.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7fcea6f3b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fcea0070550 con 0x7fcea006d130 2024-05-09T07:54:46.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7fcea6f3b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fcea00b03f0 con 0x7fcea00b0010 2024-05-09T07:54:46.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7fcea4cd7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea00b0010 0x7fcea013e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/3155557831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dc0008c10 msgr2=0x7f1dc0009090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1dd6ffd640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dc0008c10 0x7f1dc0009090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1dd6ffd640 1 -- 172.21.15.87:0/3155557831 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd80ae470 con 0x7f1dc0007dc0 2024-05-09T07:54:46.657 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7fcea4cd7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea00b0010 0x7fcea013e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47680/0 (socket says 172.21.15.87:47680) 2024-05-09T07:54:46.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7fcea4cd7640 1 -- 172.21.15.87:0/1980235641 learned_addr learned my addr 172.21.15.87:0/1980235641 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d91dd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc038390 0x7f48cc03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d91dd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f48cc0c4840 0x7f48cc039be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d91dd640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48cc038770 con 0x7f48cc039780 2024-05-09T07:54:46.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d91dd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f48cc03b350 con 0x7f48cc0c4840 2024-05-09T07:54:46.658 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d91dd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc035460 con 0x7f48cc038390 2024-05-09T07:54:46.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.632+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/3400138967 shutdown_connections 2024-05-09T07:54:46.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/3400138967 wait complete. 2024-05-09T07:54:46.659 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7fce9ffff640 1 --2- 172.21.15.87:0/1980235641 >> v2:172.21.15.87:3300/0 conn(0x7fcea006d130 0x7fcea013e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc038390 0x7f48cc03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc038390 0x7f48cc03ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47694/0 (socket says 172.21.15.87:47694) 2024-05-09T07:54:46.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d3fff640 1 -- 172.21.15.87:0/2766372998 learned_addr learned my addr 172.21.15.87:0/2766372998 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d89dc640 1 --2- 172.21.15.87:0/2766372998 >> v2:172.21.15.87:3300/0 conn(0x7f48cc0c4840 0x7f48cc039be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f48d3fff640 1 -- 172.21.15.87:0/2766372998 >> v2:172.21.15.87:3300/0 conn(0x7f48cc0c4840 msgr2=0x7f48cc039be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f3d0e0f7640 1 -- 172.21.15.87:0/653253238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00006d20 msgr2=0x7f3d000387a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f3d0e0f7640 1 --2- 172.21.15.87:0/653253238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00006d20 0x7f3d000387a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f3d0e0f7640 1 -- 172.21.15.87:0/653253238 >> v2:172.21.15.110:3300/0 conn(0x7f3d0003b130 msgr2=0x7f3d00039490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.660 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f3d0e0f7640 1 --2- 172.21.15.87:0/653253238 >> v2:172.21.15.110:3300/0 conn(0x7f3d0003b130 0x7f3d00039490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f3d0e0f7640 1 -- 172.21.15.87:0/653253238 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d00037f10 con 0x7f3d00038ce0 2024-05-09T07:54:46.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f983e8bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f98300365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f98377fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9830035a10 0x7f9830033900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43626/0 (socket says 172.21.15.87:43626) 2024-05-09T07:54:46.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f98377fe640 1 -- 172.21.15.87:0/4281026695 learned_addr learned my addr 172.21.15.87:0/4281026695 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f983e8bd640 1 -- 172.21.15.87:0/4281026695 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9830035e90 con 0x7f9830035a10 2024-05-09T07:54:46.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f983e8bd640 1 -- 172.21.15.87:0/4281026695 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983002a020 con 0x7f98300c85f0 2024-05-09T07:54:46.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f983e8bd640 1 -- 172.21.15.87:0/4281026695 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9830036130 con 0x7f9830035630 2024-05-09T07:54:46.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7fce9f7fe640 1 -- 172.21.15.87:0/1980235641 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926114639 0 0) 0x7fcea006d950 con 0x7fcea01444b0 2024-05-09T07:54:46.661 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7fce9f7fe640 1 -- 172.21.15.87:0/1980235641 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce90003520 con 0x7fcea01444b0 2024-05-09T07:54:46.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f1dd77fe640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc0007460 0x7f1dc00095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:46.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f1dd77fe640 1 -- 172.21.15.87:0/3155557831 reap_dead start 2024-05-09T07:54:46.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f1dd6ffd640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 0x7f1dc00081e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00d360 tx=0x7f1dc0009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=147d37a77fad2396 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.662 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.633+0000 7f3d0d0f5640 1 --2- 172.21.15.87:0/653253238 >> v2:172.21.15.110:3300/0 conn(0x7f3d0003b130 0x7f3d00039490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:46.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc001ba0 con 0x7f1dc0007dc0 2024-05-09T07:54:46.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc02f070 con 0x7f1dc0007dc0 2024-05-09T07:54:46.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f1dd5ffb640 1 -- 172.21.15.87:0/3155557831 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc02bac0 con 0x7f1dc0007dc0 2024-05-09T07:54:46.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7fcea4cd7640 1 -- 172.21.15.87:0/1980235641 >> v2:172.21.15.87:3300/0 conn(0x7fcea006d130 msgr2=0x7fcea013e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7fcea4cd7640 1 --2- 172.21.15.87:0/1980235641 >> v2:172.21.15.87:3300/0 conn(0x7fcea006d130 0x7fcea013e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7fcea4cd7640 1 -- 172.21.15.87:0/1980235641 >> v1:172.21.15.110:6789/0 conn(0x7fcea01444b0 legacy=0x7fcea0147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7fcea4cd7640 1 -- 172.21.15.87:0/1980235641 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea006dbf0 con 0x7fcea00b0010 2024-05-09T07:54:46.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7fce9ffff640 1 --2- 172.21.15.87:0/1980235641 >> v2:172.21.15.87:3300/0 conn(0x7fcea006d130 0x7fcea013e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:46.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9837fff640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f98300365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869641817 0 0) 0x7f983002a020 con 0x7f98300c85f0 2024-05-09T07:54:46.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9828003520 con 0x7f98300c85f0 2024-05-09T07:54:46.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f48d2ffd640 1 -- 172.21.15.87:0/2766372998 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274414857 0 0) 0x7f48cc038770 con 0x7f48cc039780 2024-05-09T07:54:46.665 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582251376 0 0) 0x7f9830035e90 con 0x7f9830035a10 2024-05-09T07:54:46.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f983002a020 con 0x7f9830035a10 2024-05-09T07:54:46.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3261824844 0 0) 0x7f9828003520 con 0x7f98300c85f0 2024-05-09T07:54:46.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 msgr2=0x7f98300365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f98300365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 >> v1:172.21.15.87:6789/0 conn(0x7f9830035a10 legacy=0x7f9830033900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9830037050 con 0x7f98300c85f0 2024-05-09T07:54:46.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f983804fe40 con 0x7f98300c85f0 2024-05-09T07:54:46.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 >> v1:172.21.15.110:6789/0 conn(0x7f98300c85f0 legacy=0x7f98300d2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98280037a0 0x7f9828003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98280040e0 0x7f982800b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f982800d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9830036130 con 0x7f98280037a0 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9828004de0 con 0x7f98280040e0 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9828004fe0 con 0x7f9830035630 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f9837fff640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98280037a0 0x7f9828003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f983ce5a640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f982800d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.634+0000 7f98377fe640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98280040e0 0x7f982800b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f48d3fff640 1 --2- 172.21.15.87:0/2766372998 >> v2:172.21.15.87:3300/0 conn(0x7f48cc0c4840 0x7f48cc039be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f48d3fff640 1 -- 172.21.15.87:0/2766372998 >> v1:172.21.15.87:6789/0 conn(0x7f48cc039780 legacy=0x7f48cc0c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f48d3fff640 1 -- 172.21.15.87:0/2766372998 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc035740 con 0x7f48cc038390 2024-05-09T07:54:46.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f1a3ffb7640 1 Processor -- start 2024-05-09T07:54:46.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f983ce5a640 1 -- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98280040e0 msgr2=0x7f982800b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f983ce5a640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98280040e0 0x7f982800b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f983ce5a640 1 -- 172.21.15.87:0/4281026695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98280037a0 msgr2=0x7f9828003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f983ce5a640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98280037a0 0x7f9828003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.668 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f983ce5a640 1 -- 172.21.15.87:0/4281026695 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9830037050 con 0x7f9830035630 2024-05-09T07:54:46.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7fc4dba2c640 1 Processor -- start 2024-05-09T07:54:46.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f48d89dc640 1 --2- 172.21.15.87:0/2766372998 >> v2:172.21.15.87:3300/0 conn(0x7f48cc0c4840 0x7f48cc039be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.669 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7fc4dba2c640 1 -- start start 2024-05-09T07:54:46.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7fcea4cd7640 1 --2- 172.21.15.87:0/1980235641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea00b0010 0x7fcea013e2c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce98009e50 tx=0x7fce9802a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa385e880ce7186 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f3d0e0f7640 1 --2- 172.21.15.87:0/653253238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00038ce0 0x7f3d000399d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d0806a280 tx=0x7f3d080a5d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe79163f0566825f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7fce9f7fe640 1 -- 172.21.15.87:0/1980235641 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98036070 con 0x7fcea00b0010 2024-05-09T07:54:46.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7fce9f7fe640 1 -- 172.21.15.87:0/1980235641 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce98031600 con 0x7fcea00b0010 2024-05-09T07:54:46.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7fce9f7fe640 1 -- 172.21.15.87:0/1980235641 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98031a10 con 0x7fcea00b0010 2024-05-09T07:54:46.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.635+0000 7f3d0c8f4640 1 -- 172.21.15.87:0/653253238 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d080b3070 con 0x7f3d00038ce0 2024-05-09T07:54:46.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f3d0c8f4640 1 -- 172.21.15.87:0/653253238 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d080a6b20 con 0x7f3d00038ce0 2024-05-09T07:54:46.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f851646b640 1 Processor -- start 2024-05-09T07:54:46.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f3d0c8f4640 1 -- 172.21.15.87:0/653253238 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d080ae440 con 0x7f3d00038ce0 2024-05-09T07:54:46.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f1a3ffb7640 1 -- start start 2024-05-09T07:54:46.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f983ce5a640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f982800d560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9838069a40 tx=0x7f9828004820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e31e37df1d56fe90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380691f0 con 0x7f9830035630 2024-05-09T07:54:46.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f1dd7fff640 1 -- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 msgr2=0x7f1dc00081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f1dd7fff640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 0x7f1dc00081e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00d360 tx=0x7f1dc0009c40 comp rx=0 tx=0).stop 2024-05-09T07:54:46.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380ad640 con 0x7f9830035630 2024-05-09T07:54:46.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fc4dba2c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4d40b3a30 0x7fc4d4147d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fc4dba2c640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40b1810 con 0x7fc4d41472d0 2024-05-09T07:54:46.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f9836ffd640 1 -- 172.21.15.87:0/4281026695 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380ada30 con 0x7f9830035630 2024-05-09T07:54:46.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fc4dba2c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40af940 con 0x7fc4d4148280 2024-05-09T07:54:46.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f851646b640 1 -- start start 2024-05-09T07:54:46.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fc4dba2c640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40b3e10 con 0x7fc4d40b3a30 2024-05-09T07:54:46.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fcea6f3b640 1 -- 172.21.15.87:0/1980235641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea00b0010 msgr2=0x7fcea013e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fcea6f3b640 1 --2- 172.21.15.87:0/1980235641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea00b0010 0x7fcea013e2c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce98009e50 tx=0x7fce9802a750 comp rx=0 tx=0).stop 2024-05-09T07:54:46.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fc4d97c8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4d40b3a30 0x7fc4d4147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7f1a3ffb7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3808ba70 0x7f1a3809ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fcea6f3b640 1 -- 172.21.15.87:0/1980235641 shutdown_connections 2024-05-09T07:54:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fcea6f3b640 1 --2- 172.21.15.87:0/1980235641 >> v2:172.21.15.87:3300/0 conn(0x7fcea006d130 0x7fcea013e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.676 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fcea6f3b640 1 --2- 172.21.15.87:0/1980235641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea00b0010 0x7fcea013e2c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fcea6f3b640 1 -- 172.21.15.87:0/1980235641 >> 172.21.15.87:0/1980235641 conn(0x7fcea00b6630 msgr2=0x7fcea00b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fc4d97c8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc4d40b3a30 0x7fc4d4147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55752/0 (socket says 172.21.15.87:55752) 2024-05-09T07:54:46.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.636+0000 7fc4d97c8640 1 -- 172.21.15.87:0/4109788515 learned_addr learned my addr 172.21.15.87:0/4109788515 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1a3ffb7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a380add80 0x7f1a3809b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fcea6f3b640 1 -- 172.21.15.87:0/1980235641 shutdown_connections 2024-05-09T07:54:46.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fcea6f3b640 1 -- 172.21.15.87:0/1980235641 wait complete. 2024-05-09T07:54:46.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/653253238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00038ce0 msgr2=0x7f3d000399d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/653253238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00038ce0 0x7f3d000399d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d0806a280 tx=0x7f3d080a5d10 comp rx=0 tx=0).stop 2024-05-09T07:54:46.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1a3ffb7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380b39d0 0x7f1a381f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1a3ffb7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3806c730 con 0x7f1a3808ba70 2024-05-09T07:54:46.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f48d3fff640 1 --2- 172.21.15.87:0/2766372998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc038390 0x7f48cc03ad30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009870 tx=0x7f48c802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c12577f0014acc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1a3e554640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380b39d0 0x7f1a381f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f851646b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85100b6130 0x7f85100b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f851646b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85100b6510 con 0x7f851014c880 2024-05-09T07:54:46.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f851646b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85100b1210 con 0x7f85100b31c0 2024-05-09T07:54:46.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f851646b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f85100b0fc0 con 0x7f85100b6130 2024-05-09T07:54:46.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1a3e554640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380b39d0 0x7f1a381f2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47720/0 (socket says 172.21.15.87:47720) 2024-05-09T07:54:46.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f8514a08640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f851014c880 0x7f8510156450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43648/0 (socket says 172.21.15.87:43648) 2024-05-09T07:54:46.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f8514a08640 1 -- 172.21.15.87:0/1050978543 learned_addr learned my addr 172.21.15.87:0/1050978543 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:46.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1a3e554640 1 -- 172.21.15.87:0/2435870338 learned_addr learned my addr 172.21.15.87:0/2435870338 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/653253238 shutdown_connections 2024-05-09T07:54:46.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/653253238 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00038ce0 0x7f3d000399d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/653253238 >> v2:172.21.15.110:3300/0 conn(0x7f3d0003b130 0x7f3d00039490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/653253238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00006d20 0x7f3d000387a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/653253238 >> 172.21.15.87:0/653253238 conn(0x7f3d000086e0 msgr2=0x7f3d0003eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/2435870338 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1a380b4fe0 con 0x7f1a380add80 2024-05-09T07:54:46.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f850ffff640 1 --2- 172.21.15.87:0/1050978543 >> v2:172.21.15.110:3300/0 conn(0x7f85100b6130 0x7f85100b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f983e8bd640 1 -- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 msgr2=0x7f982800d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f983e8bd640 1 --2- 172.21.15.87:0/4281026695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f982800d560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9838069a40 tx=0x7f9828004820 comp rx=0 tx=0).stop 2024-05-09T07:54:46.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1dd7fff640 1 -- 172.21.15.87:0/3155557831 shutdown_connections 2024-05-09T07:54:46.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1dd7fff640 1 --2- 172.21.15.87:0/3155557831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 0x7f1dc00081e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1dd7fff640 1 -- 172.21.15.87:0/3155557831 >> 172.21.15.87:0/3155557831 conn(0x7f1dd80b5650 msgr2=0x7f1dd80b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f48d2ffd640 1 -- 172.21.15.87:0/2766372998 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8037070 con 0x7f48cc038390 2024-05-09T07:54:46.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f48d2ffd640 1 -- 172.21.15.87:0/2766372998 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c8032440 con 0x7f48cc038390 2024-05-09T07:54:46.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f983ce5a640 1 -- 172.21.15.87:0/4281026695 reap_dead start 2024-05-09T07:54:46.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f983e8bd640 1 -- 172.21.15.87:0/4281026695 shutdown_connections 2024-05-09T07:54:46.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f983e8bd640 1 -- 172.21.15.87:0/4281026695 >> 172.21.15.87:0/4281026695 conn(0x7f983003ac20 msgr2=0x7f9830005ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1dd7fff640 1 -- 172.21.15.87:0/3155557831 shutdown_connections 2024-05-09T07:54:46.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1dd7fff640 1 -- 172.21.15.87:0/3155557831 wait complete. 2024-05-09T07:54:46.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f48d2ffd640 1 -- 172.21.15.87:0/2766372998 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8032810 con 0x7f48cc038390 2024-05-09T07:54:46.692 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1a3dd53640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3808ba70 0x7f1a3809ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1021706542 0 0) 0x7fc4d40af940 con 0x7fc4d4148280 2024-05-09T07:54:46.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4c0003520 con 0x7fc4d4148280 2024-05-09T07:54:46.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2697756609 0 0) 0x7fc4c8001110 con 0x7fc4d41472d0 2024-05-09T07:54:46.693 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4d40af940 con 0x7fc4d41472d0 2024-05-09T07:54:46.694 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/2435870338 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3806c8b0 con 0x7f1a380b39d0 2024-05-09T07:54:46.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2414265592 0 0) 0x7fc4c0003520 con 0x7fc4d4148280 2024-05-09T07:54:46.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 >> v2:172.21.15.87:3300/0 conn(0x7fc4d40b3a30 msgr2=0x7fc4d4147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 --2- 172.21.15.87:0/4109788515 >> v2:172.21.15.87:3300/0 conn(0x7fc4d40b3a30 0x7fc4d4147d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 >> v1:172.21.15.87:6789/0 conn(0x7fc4d41472d0 legacy=0x7fc4d40b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40b0260 con 0x7fc4d4148280 2024-05-09T07:54:46.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7fc4d0001670 con 0x7fc4d4148280 2024-05-09T07:54:46.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 >> v1:172.21.15.110:6789/0 conn(0x7fc4d4148280 legacy=0x7fc4d4146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4c0004ba0 0x7fc4c0004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.637+0000 7fc4c7fff640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4c0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.696 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4c7fff640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c00041d0 0x7fc4c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40b3e10 con 0x7fc4c00037a0 2024-05-09T07:54:46.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c000c190 con 0x7fc4c00041d0 2024-05-09T07:54:46.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c000c390 con 0x7fc4c0004ba0 2024-05-09T07:54:46.697 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f983e8bd640 1 -- 172.21.15.87:0/4281026695 shutdown_connections 2024-05-09T07:54:46.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f983e8bd640 1 -- 172.21.15.87:0/4281026695 wait complete. 2024-05-09T07:54:46.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4d9fc9640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c00041d0 0x7fc4c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.698 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4d8fc7640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4c0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f1a3e554640 1 -- 172.21.15.87:0/2435870338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a380add80 msgr2=0x7f1a3809b720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f1a3e554640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a380add80 0x7f1a3809b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f1a3e554640 1 -- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3808ba70 msgr2=0x7f1a3809ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f1a3e554640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3808ba70 0x7f1a3809ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f1a3e554640 1 -- 172.21.15.87:0/2435870338 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3809b270 con 0x7f1a380b39d0 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f1a3e554640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380b39d0 0x7f1a381f2780 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c4d0 tx=0x7f1a3400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f1a2e7fc640 1 -- 172.21.15.87:0/2435870338 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34018070 con 0x7f1a380b39d0 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f1a2e7fc640 1 -- 172.21.15.87:0/2435870338 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a340074e0 con 0x7f1a380b39d0 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/2435870338 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3809e060 con 0x7f1a380b39d0 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/2435870338 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a3809dd80 con 0x7f1a380b39d0 2024-05-09T07:54:46.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f1a2e7fc640 1 -- 172.21.15.87:0/2435870338 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a340049e0 con 0x7f1a380b39d0 2024-05-09T07:54:46.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f1dd7fff640 1 Processor -- start 2024-05-09T07:54:46.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4d97c8640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4c0004ba0 0x7fc4c0004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4d8fc7640 1 -- 172.21.15.87:0/4109788515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4c0004ba0 msgr2=0x7fc4c0004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4d8fc7640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4c0004ba0 0x7fc4c0004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4d8fc7640 1 -- 172.21.15.87:0/4109788515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c00041d0 msgr2=0x7fc4c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:46.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fc4d8fc7640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c00041d0 0x7fc4c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7fc4d8fc7640 1 -- 172.21.15.87:0/4109788515 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40b0260 con 0x7fc4c00037a0 2024-05-09T07:54:46.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7fc4d9fc9640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c00041d0 0x7fc4c000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:46.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7fc4d9fc9640 1 -- 172.21.15.87:0/4109788515 reap_dead start 2024-05-09T07:54:46.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fcea6f3b640 1 Processor -- start 2024-05-09T07:54:46.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7fcea6f3b640 1 -- start start 2024-05-09T07:54:46.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7fcea6f3b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea006d130 0x7fcea013b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7fcea6f3b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea00b0010 0x7fcea01e0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7fcea6f3b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea01444b0 0x7fcea01dd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7fcea6f3b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fcea00b6270 con 0x7fcea006d130 2024-05-09T07:54:46.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7fcea6f3b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcea006e1b0 con 0x7fcea00b0010 2024-05-09T07:54:46.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7fcea6f3b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fcea0144920 con 0x7fcea01444b0 2024-05-09T07:54:46.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f48d91dd640 1 -- 172.21.15.87:0/2766372998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc038390 msgr2=0x7f48cc03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f48d91dd640 1 --2- 172.21.15.87:0/2766372998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc038390 0x7f48cc03ad30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009870 tx=0x7f48c802a250 comp rx=0 tx=0).stop 2024-05-09T07:54:46.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f48d91dd640 1 -- 172.21.15.87:0/2766372998 shutdown_connections 2024-05-09T07:54:46.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f48d91dd640 1 --2- 172.21.15.87:0/2766372998 >> v2:172.21.15.87:3300/0 conn(0x7f48cc0c4840 0x7f48cc039be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f48d91dd640 1 --2- 172.21.15.87:0/2766372998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc038390 0x7f48cc03ad30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f48d91dd640 1 -- 172.21.15.87:0/2766372998 >> 172.21.15.87:0/2766372998 conn(0x7f48cc008680 msgr2=0x7f48cc03eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f48d91dd640 1 -- 172.21.15.87:0/2766372998 shutdown_connections 2024-05-09T07:54:46.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f48d91dd640 1 -- 172.21.15.87:0/2766372998 wait complete. 2024-05-09T07:54:46.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f983e8bd640 1 Processor -- start 2024-05-09T07:54:46.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f983e8bd640 1 -- start start 2024-05-09T07:54:46.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f850ffff640 1 -- 172.21.15.87:0/1050978543 >> v1:172.21.15.110:6789/0 conn(0x7f85100b31c0 legacy=0x7f851014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f850ffff640 1 -- 172.21.15.87:0/1050978543 >> v1:172.21.15.87:6789/0 conn(0x7f851014c880 legacy=0x7f8510156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f850ffff640 1 -- 172.21.15.87:0/1050978543 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85100b1850 con 0x7f85100b6130 2024-05-09T07:54:46.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f850ffff640 1 --2- 172.21.15.87:0/1050978543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 0x7f85100b04d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85000097a0 tx=0x7f850002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff66ebadfe5e0269 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.638+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/653253238 shutdown_connections 2024-05-09T07:54:46.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7fce9ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea00b0010 0x7fcea01e0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7fce9ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea00b0010 0x7fcea01e0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:37722/0 (socket says 172.21.15.87:37722) 2024-05-09T07:54:46.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7fce9ffff640 1 -- 172.21.15.87:0/490130088 learned_addr learned my addr 172.21.15.87:0/490130088 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/653253238 wait complete. 2024-05-09T07:54:46.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.639+0000 7f1dd7fff640 1 -- start start 2024-05-09T07:54:46.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7f850f7fe640 1 -- 172.21.15.87:0/1050978543 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500037070 con 0x7f85100b6130 2024-05-09T07:54:46.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7f850f7fe640 1 -- 172.21.15.87:0/1050978543 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8500032440 con 0x7f85100b6130 2024-05-09T07:54:46.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7f850f7fe640 1 -- 172.21.15.87:0/1050978543 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000327f0 con 0x7f85100b6130 2024-05-09T07:54:46.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7f48d91dd640 1 Processor -- start 2024-05-09T07:54:46.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7fcea4cd7640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea006d130 0x7fcea013b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 0x7f1dd81465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7f48d91dd640 1 -- start start 2024-05-09T07:54:46.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7fcea54d8640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea01444b0 0x7fcea01dd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.640+0000 7f983e8bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f98300c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd8141390 0x7f1dd8143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f983e8bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f983015d240 0x7f983015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd8071430 0x7f1dd8139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd7fff640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd80b6170 con 0x7f1dd8141390 2024-05-09T07:54:46.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd7fff640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd809e230 con 0x7f1dd8071430 2024-05-09T07:54:46.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd7fff640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd80b62f0 con 0x7f1dc0007dc0 2024-05-09T07:54:46.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f851646b640 1 -- 172.21.15.87:0/1050978543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 msgr2=0x7f85100b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f851646b640 1 --2- 172.21.15.87:0/1050978543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 0x7f85100b04d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85000097a0 tx=0x7f850002a1e0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f98377fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f983015d240 0x7f983015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7fce9ffff640 1 -- 172.21.15.87:0/490130088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea01444b0 msgr2=0x7fcea01dd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7fce9ffff640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea01444b0 0x7fcea01dd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7fce9ffff640 1 -- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea006d130 msgr2=0x7fcea013b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7fce9ffff640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea006d130 0x7fcea013b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7fce9ffff640 1 -- 172.21.15.87:0/490130088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea00b2520 con 0x7fcea00b0010 2024-05-09T07:54:46.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7fce9ffff640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea00b0010 0x7fcea01e0820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00ec10 tx=0x7fce8c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.710 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd8071430 0x7f1dd8139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f851646b640 1 -- 172.21.15.87:0/1050978543 shutdown_connections 2024-05-09T07:54:46.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f851646b640 1 --2- 172.21.15.87:0/1050978543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 0x7f85100b04d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f851646b640 1 -- 172.21.15.87:0/1050978543 >> 172.21.15.87:0/1050978543 conn(0x7f8510067380 msgr2=0x7f8510067790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd8071430 0x7f1dd8139c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:37742/0 (socket says 172.21.15.87:37742) 2024-05-09T07:54:46.711 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd77fe640 1 -- 172.21.15.87:0/185981896 learned_addr learned my addr 172.21.15.87:0/185981896 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7fc4d8fc7640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4c0003c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c240 tx=0x7fc4c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e74ef10044e750 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f48d91dd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48cc038390 0x7f48cc0c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd6ffd640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 0x7f1dd81465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f48d91dd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48cc039780 0x7f48cc0c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f98377fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f983015d240 0x7f983015d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:37730/0 (socket says 172.21.15.87:37730) 2024-05-09T07:54:46.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f851646b640 1 -- 172.21.15.87:0/1050978543 shutdown_connections 2024-05-09T07:54:46.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f851646b640 1 -- 172.21.15.87:0/1050978543 wait complete. 2024-05-09T07:54:46.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f98377fe640 1 -- 172.21.15.87:0/1861725330 learned_addr learned my addr 172.21.15.87:0/1861725330 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f983e8bd640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98301607b0 0x7f9830160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f1dd67fc640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd8141390 0x7f1dd8143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7f3d0e8f8640 1 Processor -- start 2024-05-09T07:54:46.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f1dd77fe640 1 -- 172.21.15.87:0/185981896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 msgr2=0x7f1dd81465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f1a2e7fc640 1 -- 172.21.15.87:0/2435870338 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a3401b070 con 0x7f1a380b39d0 2024-05-09T07:54:46.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f98300c8a60 con 0x7f98301607b0 2024-05-09T07:54:46.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f983000aee0 con 0x7f983015d240 2024-05-09T07:54:46.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f983ce5a640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98301607b0 0x7f9830160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f1dd77fe640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 0x7f1dd81465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48cc039780 0x7f48cc0c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48cc038390 0x7f48cc0c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d3fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48cc038390 0x7f48cc0c00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:37750/0 (socket says 172.21.15.87:37750) 2024-05-09T07:54:46.716 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d37fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48cc039780 0x7f48cc0c2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55798/0 (socket says 172.21.15.87:55798) 2024-05-09T07:54:46.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/2435870338 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a380b4850 con 0x7f1a380b39d0 2024-05-09T07:54:46.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0007d30 con 0x7fc4c00037a0 2024-05-09T07:54:46.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d0005270 con 0x7fc4c00037a0 2024-05-09T07:54:46.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7fc4c7fff640 1 -- 172.21.15.87:0/4109788515 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0003610 con 0x7fc4c00037a0 2024-05-09T07:54:46.717 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d91dd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc0c4840 0x7f48cc03c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.641+0000 7fce9d7fa640 1 -- 172.21.15.87:0/490130088 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c017070 con 0x7fcea00b0010 2024-05-09T07:54:46.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7fce9d7fa640 1 -- 172.21.15.87:0/490130088 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c00cc30 con 0x7fcea00b0010 2024-05-09T07:54:46.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7fce9d7fa640 1 -- 172.21.15.87:0/490130088 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c013470 con 0x7fcea00b0010 2024-05-09T07:54:46.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7fcea6f3b640 1 -- 172.21.15.87:0/490130088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea01e0ef0 con 0x7fcea00b0010 2024-05-09T07:54:46.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7fcea6f3b640 1 -- 172.21.15.87:0/490130088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea01e1500 con 0x7fcea00b0010 2024-05-09T07:54:46.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d91dd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc03a4c0 con 0x7f48cc039780 2024-05-09T07:54:46.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f1a2e7fc640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a1c06be30 0x7f1a1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f1a2e7fc640 1 -- 172.21.15.87:0/2435870338 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1a3408a130 con 0x7f1a380b39d0 2024-05-09T07:54:46.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d91dd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc03a340 con 0x7f48cc038390 2024-05-09T07:54:46.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d91dd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f48cc035f10 con 0x7f48cc0c4840 2024-05-09T07:54:46.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d89dc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc0c4840 0x7f48cc03c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f48d3fff640 1 -- 172.21.15.87:0/2049170489 learned_addr learned my addr 172.21.15.87:0/2049170489 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f48d89dc640 1 -- 172.21.15.87:0/2049170489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48cc038390 msgr2=0x7f48cc0c00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f48d89dc640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48cc038390 0x7f48cc0c00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f48d89dc640 1 -- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48cc039780 msgr2=0x7f48cc0c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f48d89dc640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48cc039780 0x7f48cc0c2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f48d89dc640 1 -- 172.21.15.87:0/2049170489 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc0c3510 con 0x7f48cc0c4840 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f48d37fe640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48cc039780 0x7f48cc0c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f48d3fff640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48cc038390 0x7f48cc0c00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f3d0e8f8640 1 -- start start 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0e8f8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00006d20 0x7f3d000d2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0e8f8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00038ce0 0x7f3d001696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0e8f8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d0003b130 0x7f3d000d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0e8f8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00036b80 con 0x7f3d00006d20 2024-05-09T07:54:46.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0e8f8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3d000d3fc0 con 0x7f3d0003b130 2024-05-09T07:54:46.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f9837fff640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f98300c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f98300c8be0 con 0x7f9830035630 2024-05-09T07:54:46.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f851646b640 1 Processor -- start 2024-05-09T07:54:46.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0d0f5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00038ce0 0x7f3d001696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0d0f5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00038ce0 0x7f3d001696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47782/0 (socket says 172.21.15.87:47782) 2024-05-09T07:54:46.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0d0f5640 1 -- 172.21.15.87:0/3855730043 learned_addr learned my addr 172.21.15.87:0/3855730043 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3d00035f10 con 0x7f3d00038ce0 2024-05-09T07:54:46.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0e0f7640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d0003b130 0x7f3d000d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f1dd77fe640 1 -- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd8141390 msgr2=0x7f1dd8143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f1dd77fe640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd8141390 0x7f1dd8143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.642+0000 7f1dd77fe640 1 -- 172.21.15.87:0/185981896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd81439d0 con 0x7f1dd8071430 2024-05-09T07:54:46.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f3d0d8f6640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00006d20 0x7f3d000d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f1dd67fc640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd8141390 0x7f1dd8143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:46.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f1dd77fe640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd8071430 0x7f1dd8139c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80b6a00 tx=0x7f1dd0007700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f1dbf7fe640 1 -- 172.21.15.87:0/185981896 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0009be0 con 0x7f1dd8071430 2024-05-09T07:54:46.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f1dbf7fe640 1 -- 172.21.15.87:0/185981896 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd001a070 con 0x7f1dd8071430 2024-05-09T07:54:46.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f1dbf7fe640 1 -- 172.21.15.87:0/185981896 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0015660 con 0x7f1dd8071430 2024-05-09T07:54:46.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f1dd7fff640 1 -- 172.21.15.87:0/185981896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd8143540 con 0x7f1dd8071430 2024-05-09T07:54:46.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f1dd7fff640 1 -- 172.21.15.87:0/185981896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd8141b90 con 0x7f1dd8071430 2024-05-09T07:54:46.724 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f3d0d0f5640 1 -- 172.21.15.87:0/3855730043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d0003b130 msgr2=0x7f3d000d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f98377fe640 1 -- 172.21.15.87:0/1861725330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 msgr2=0x7f98300c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f98377fe640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f98300c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f98377fe640 1 -- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98301607b0 msgr2=0x7f9830160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f98377fe640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98301607b0 0x7f9830160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f98377fe640 1 -- 172.21.15.87:0/1861725330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983002c6b0 con 0x7f983015d240 2024-05-09T07:54:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f983ce5a640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98301607b0 0x7f9830160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f98377fe640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f983015d240 0x7f983015d6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9824001580 tx=0x7f9824001a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f9837fff640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f98300c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7f851646b640 1 -- start start 2024-05-09T07:54:46.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f3d0d0f5640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d0003b130 0x7f3d000d2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f9834ff9640 1 -- 172.21.15.87:0/1861725330 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982401a070 con 0x7f983015d240 2024-05-09T07:54:46.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f3d0d0f5640 1 -- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00006d20 msgr2=0x7f3d000d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f9834ff9640 1 -- 172.21.15.87:0/1861725330 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982400f750 con 0x7f983015d240 2024-05-09T07:54:46.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f9834ff9640 1 -- 172.21.15.87:0/1861725330 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982400fb40 con 0x7f983015d240 2024-05-09T07:54:46.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983002af00 con 0x7f983015d240 2024-05-09T07:54:46.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f3d0d0f5640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00006d20 0x7f3d000d2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f3d0d0f5640 1 -- 172.21.15.87:0/3855730043 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d000cc260 con 0x7f3d00038ce0 2024-05-09T07:54:46.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98300c4e30 con 0x7f983015d240 2024-05-09T07:54:46.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f3d0e0f7640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d0003b130 0x7f3d000d2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:46.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f3d0d8f6640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00006d20 0x7f3d000d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:46.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f3d0d0f5640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00038ce0 0x7f3d001696d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e8d0 tx=0x7f3d0400ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f851646b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85100b31c0 0x7f85100725f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f851646b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 0x7f8510071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f851646b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f851014c880 0x7f8510070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f851646b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f85100b00d0 con 0x7f85100b31c0 2024-05-09T07:54:46.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f48d89dc640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc0c4840 0x7f48cc03c8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f48d4064d50 tx=0x7f48d4068700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f851646b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f85100b1600 con 0x7f85100b6130 2024-05-09T07:54:46.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f851646b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f85100b0250 con 0x7f851014c880 2024-05-09T07:54:46.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f850ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85100b31c0 0x7f85100725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f850ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85100b31c0 0x7f85100725f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55830/0 (socket says 172.21.15.87:55830) 2024-05-09T07:54:46.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f850ffff640 1 -- 172.21.15.87:0/2249550036 learned_addr learned my addr 172.21.15.87:0/2249550036 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f8507fff640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 0x7f8510071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7f8514a08640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f851014c880 0x7f8510070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7fc4dba2c640 1 -- 172.21.15.87:0/4109788515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 msgr2=0x7fc4c0003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.643+0000 7fc4dba2c640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4c0003c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000c240 tx=0x7fc4c0005830 comp rx=0 tx=0).stop 2024-05-09T07:54:46.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f850ffff640 1 -- 172.21.15.87:0/2249550036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f851014c880 msgr2=0x7f8510070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7fc4dba2c640 1 -- 172.21.15.87:0/4109788515 shutdown_connections 2024-05-09T07:54:46.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7fc4dba2c640 1 --2- 172.21.15.87:0/4109788515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4c0003c20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7fc4dba2c640 1 -- 172.21.15.87:0/4109788515 >> 172.21.15.87:0/4109788515 conn(0x7fc4d40b5860 msgr2=0x7fc4d40b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:46.732 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f1a3dd53640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a1c06be30 0x7f1a1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f850ffff640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f851014c880 0x7f8510070130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.644+0000 7fce8affd640 1 -- 172.21.15.87:0/490130088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce78005290 con 0x7fcea00b0010 2024-05-09T07:54:46.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f850ffff640 1 -- 172.21.15.87:0/2249550036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 msgr2=0x7f8510071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f850ffff640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 0x7f8510071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.733 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f850ffff640 1 -- 172.21.15.87:0/2249550036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8510071b80 con 0x7f85100b31c0 2024-05-09T07:54:46.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7fc4dba2c640 1 -- 172.21.15.87:0/4109788515 shutdown_connections 2024-05-09T07:54:46.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f1a3dd53640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a1c06be30 0x7f1a1c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a300075b0 tx=0x7f1a30007540 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7fc4dba2c640 1 -- 172.21.15.87:0/4109788515 wait complete. 2024-05-09T07:54:46.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9818005290 con 0x7f983015d240 2024-05-09T07:54:46.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f1dbd7fa640 1 -- 172.21.15.87:0/185981896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1db0005290 con 0x7f1dd8071430 2024-05-09T07:54:46.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f850ffff640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85100b31c0 0x7f85100725f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85000097a0 tx=0x7f85000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7f8507fff640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 0x7f8510071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:46.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7f850d7fa640 1 -- 172.21.15.87:0/2249550036 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500037040 con 0x7f85100b31c0 2024-05-09T07:54:46.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7f850d7fa640 1 -- 172.21.15.87:0/2249550036 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8500042070 con 0x7f85100b31c0 2024-05-09T07:54:46.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8510071e60 con 0x7f85100b31c0 2024-05-09T07:54:46.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7f850d7fa640 1 -- 172.21.15.87:0/2249550036 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500032830 con 0x7f85100b31c0 2024-05-09T07:54:46.736 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7f9834ff9640 1 -- 172.21.15.87:0/1861725330 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f982401d070 con 0x7f983015d240 2024-05-09T07:54:46.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85100715b0 con 0x7f85100b31c0 2024-05-09T07:54:46.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.645+0000 7fce9d7fa640 1 -- 172.21.15.87:0/490130088 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce8c01a070 con 0x7fcea00b0010 2024-05-09T07:54:46.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7fce9d7fa640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fce8406bf00 0x7fce8406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7fce9d7fa640 1 -- 172.21.15.87:0/490130088 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce8c08b020 con 0x7fcea00b0010 2024-05-09T07:54:46.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7fcea4cd7640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fce8406bf00 0x7fce8406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.646+0000 7f1dbf7fe640 1 -- 172.21.15.87:0/185981896 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1dd0015800 con 0x7f1dd8071430 2024-05-09T07:54:46.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7f9834ff9640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f981c06bf30 0x7f981c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7fc4dba2c640 1 Processor -- start 2024-05-09T07:54:46.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7fcea4cd7640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fce8406bf00 0x7fce8406e3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce98033000 tx=0x7fce98009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7f9834ff9640 1 -- 172.21.15.87:0/1861725330 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f982408a670 con 0x7f983015d240 2024-05-09T07:54:46.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7f9837fff640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f981c06bf30 0x7f981c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7f1dbf7fe640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1dc406bf00 0x7f1dc406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7f1dbf7fe640 1 -- 172.21.15.87:0/185981896 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1dd008bf00 con 0x7f1dd8071430 2024-05-09T07:54:46.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7f1dd6ffd640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1dc406bf00 0x7f1dc406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f851006fd90 con 0x7f85100b31c0 2024-05-09T07:54:46.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7fc4dba2c640 1 -- start start 2024-05-09T07:54:46.740 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.647+0000 7f9837fff640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f981c06bf30 0x7f981c06e3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f982c019f90 tx=0x7f982c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f1dd6ffd640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1dc406bf00 0x7f1dc406e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc034000 tx=0x7f1dcc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f3cfe7fc640 1 -- 172.21.15.87:0/3855730043 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04017070 con 0x7f3d00038ce0 2024-05-09T07:54:46.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4dba2c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4d4146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4dba2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4d4072450 0x7fc4d41e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f48d0ff9640 1 -- 172.21.15.87:0/2049170489 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d40947e0 con 0x7f48cc0c4840 2024-05-09T07:54:46.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f3cfe7fc640 1 -- 172.21.15.87:0/3855730043 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0400c940 con 0x7f3d00038ce0 2024-05-09T07:54:46.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4dba2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4d4135ab0 0x7fc4d4135f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d000cc7b0 con 0x7f3d00038ce0 2024-05-09T07:54:46.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4dba2c640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40b0500 con 0x7fc4c00037a0 2024-05-09T07:54:46.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc15deb0 con 0x7f48cc0c4840 2024-05-09T07:54:46.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4d97c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4d4146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f850d7fa640 1 -- 172.21.15.87:0/2249550036 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85000329d0 con 0x7f85100b31c0 2024-05-09T07:54:46.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f3cfe7fc640 1 -- 172.21.15.87:0/3855730043 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400cd30 con 0x7f3d00038ce0 2024-05-09T07:54:46.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d000cc4d0 con 0x7f3d00038ce0 2024-05-09T07:54:46.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc03e730 con 0x7f48cc0c4840 2024-05-09T07:54:46.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4d97c8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4d4146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55840/0 (socket says 172.21.15.87:55840) 2024-05-09T07:54:46.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4d97c8640 1 -- 172.21.15.87:0/1494524750 learned_addr learned my addr 172.21.15.87:0/1494524750 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:46.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f48d0ff9640 1 -- 172.21.15.87:0/2049170489 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d4098030 con 0x7f48cc0c4840 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4dba2c640 1 -- 172.21.15.87:0/1494524750 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40afbe0 con 0x7fc4d4072450 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4dba2c640 1 -- 172.21.15.87:0/1494524750 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d40b11b0 con 0x7fc4d4135ab0 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4d8fc7640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4d4072450 0x7fc4d41e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7fc4d9fc9640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4d4135ab0 0x7fc4d4135f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7fc4d97c8640 1 -- 172.21.15.87:0/1494524750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4d4135ab0 msgr2=0x7fc4d4135f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7fc4d97c8640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4d4135ab0 0x7fc4d4135f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7fc4d97c8640 1 -- 172.21.15.87:0/1494524750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4d4072450 msgr2=0x7fc4d41e49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7fc4d97c8640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4d4072450 0x7fc4d41e49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7fc4d97c8640 1 -- 172.21.15.87:0/1494524750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d413c3b0 con 0x7fc4c00037a0 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7fc4d9fc9640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4d4135ab0 0x7fc4d4135f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:46.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7fc4d97c8640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4d4146020 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0046e0 tx=0x7fc4cc0077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7f850d7fa640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f84f006be30 0x7f84f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7f850d7fa640 1 -- 172.21.15.87:0/2249550036 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f85000ab900 con 0x7f85100b31c0 2024-05-09T07:54:46.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.648+0000 7f1a2e7fc640 1 -- 172.21.15.87:0/2435870338 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1a34058480 con 0x7f1a380b39d0 2024-05-09T07:54:46.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7f48d0ff9640 1 -- 172.21.15.87:0/2049170489 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4094ba0 con 0x7f48cc0c4840 2024-05-09T07:54:46.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7f8507fff640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f84f006be30 0x7f84f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.650+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b4005290 con 0x7f48cc0c4840 2024-05-09T07:54:46.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.650+0000 7f8507fff640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f84f006be30 0x7f84f006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f851014a430 tx=0x7f84f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.649+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf0005290 con 0x7f3d00038ce0 2024-05-09T07:54:46.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.651+0000 7f3cfe7fc640 1 -- 172.21.15.87:0/3855730043 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d0401a070 con 0x7f3d00038ce0 2024-05-09T07:54:46.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.651+0000 7f48d0ff9640 1 -- 172.21.15.87:0/2049170489 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48d409d420 con 0x7f48cc0c4840 2024-05-09T07:54:46.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.651+0000 7f48d0ff9640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f48b806be30 0x7f48b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.651+0000 7fce9d7fa640 1 -- 172.21.15.87:0/490130088 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fce8c0593f0 con 0x7fcea00b0010 2024-05-09T07:54:46.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.651+0000 7f48d0ff9640 1 -- 172.21.15.87:0/2049170489 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f48d410f510 con 0x7f48cc0c4840 2024-05-09T07:54:46.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.651+0000 7f48d3fff640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f48b806be30 0x7f48b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.651+0000 7f3cfe7fc640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3cec06be30 0x7f3cec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.651+0000 7f3cfe7fc640 1 -- 172.21.15.87:0/3855730043 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3d0408a7f0 con 0x7f3d00038ce0 2024-05-09T07:54:46.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.651+0000 7f3d0d8f6640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3cec06be30 0x7f3cec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.652+0000 7f3d0d8f6640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3cec06be30 0x7f3cec06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009f30 tx=0x7f3cf8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.652+0000 7f48d3fff640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f48b806be30 0x7f48b806e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f48c80090b0 tx=0x7f48c802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.656+0000 7f3cfe7fc640 1 -- 172.21.15.87:0/3855730043 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3d04058b40 con 0x7f3d00038ce0 2024-05-09T07:54:46.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.656+0000 7f1dbf7fe640 1 -- 172.21.15.87:0/185981896 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1dd005a920 con 0x7f1dd8071430 2024-05-09T07:54:46.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.657+0000 7fc4c5ffb640 1 -- 172.21.15.87:0/1494524750 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc015480 con 0x7fc4c00037a0 2024-05-09T07:54:46.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.657+0000 7f850d7fa640 1 -- 172.21.15.87:0/2249550036 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f850007a220 con 0x7f85100b31c0 2024-05-09T07:54:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.657+0000 7fc4dba2c640 1 -- 172.21.15.87:0/1494524750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d413c690 con 0x7fc4c00037a0 2024-05-09T07:54:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.658+0000 7fc4dba2c640 1 -- 172.21.15.87:0/1494524750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d409ad00 con 0x7fc4c00037a0 2024-05-09T07:54:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.658+0000 7fc4c5ffb640 1 -- 172.21.15.87:0/1494524750 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc01a070 con 0x7fc4c00037a0 2024-05-09T07:54:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.658+0000 7fc4c5ffb640 1 -- 172.21.15.87:0/1494524750 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc015840 con 0x7fc4c00037a0 2024-05-09T07:54:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.659+0000 7fc4bf7fe640 1 -- 172.21.15.87:0/1494524750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d40691f0 con 0x7fc4c00037a0 2024-05-09T07:54:46.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.660+0000 7fc4c5ffb640 1 -- 172.21.15.87:0/1494524750 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4cc0159e0 con 0x7fc4c00037a0 2024-05-09T07:54:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.660+0000 7f48d0ff9640 1 -- 172.21.15.87:0/2049170489 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f48cc0c3510 con 0x7f48cc0c4840 2024-05-09T07:54:46.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.661+0000 7f9834ff9640 1 -- 172.21.15.87:0/1861725330 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9824058a40 con 0x7f983015d240 2024-05-09T07:54:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.661+0000 7fc4c5ffb640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc4b806be30 0x7fc4b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.661+0000 7fc4c5ffb640 1 -- 172.21.15.87:0/1494524750 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc4cc08baf0 con 0x7fc4c00037a0 2024-05-09T07:54:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.662+0000 7fc4d8fc7640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc4b806be30 0x7fc4b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.663+0000 7fc4d8fc7640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc4b806be30 0x7fc4b806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0033000 tx=0x7fc4d0035040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:46.756 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:46.670+0000 7fc4c5ffb640 1 -- 172.21.15.87:0/1494524750 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc4cc010050 con 0x7fc4c00037a0 2024-05-09T07:54:47.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.063+0000 7fce8affd640 1 -- 172.21.15.87:0/490130088 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fce78005580 con 0x7fcea00b0010 2024-05-09T07:54:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.063+0000 7fce9d7fa640 1 -- 172.21.15.87:0/490130088 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fce8c05d6f0 con 0x7fcea00b0010 2024-05-09T07:54:47.078 INFO:teuthology.orchestra.run.smithi087.stdout:60129542150 2024-05-09T07:54:47.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.064+0000 7f1a3ffb7640 1 -- 172.21.15.87:0/2435870338 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1a380756c0 con 0x7f1a380b39d0 2024-05-09T07:54:47.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.065+0000 7f1a2e7fc640 1 -- 172.21.15.87:0/2435870338 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a3405c780 con 0x7f1a380b39d0 2024-05-09T07:54:47.080 INFO:teuthology.orchestra.run.smithi087.stdout:55834574854 2024-05-09T07:54:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.067+0000 7fce8affd640 1 -- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fce8406bf00 msgr2=0x7fce8406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.067+0000 7fce8affd640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fce8406bf00 0x7fce8406e3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce98033000 tx=0x7fce98009000 comp rx=0 tx=0).stop 2024-05-09T07:54:47.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.067+0000 7fce8affd640 1 -- 172.21.15.87:0/490130088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea00b0010 msgr2=0x7fcea01e0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.067+0000 7fce8affd640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea00b0010 0x7fcea01e0820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00ec10 tx=0x7fce8c00c520 comp rx=0 tx=0).stop 2024-05-09T07:54:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.067+0000 7fce8affd640 1 -- 172.21.15.87:0/490130088 shutdown_connections 2024-05-09T07:54:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.067+0000 7fce8affd640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fce8406bf00 0x7fce8406e3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.067+0000 7fce8affd640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcea01444b0 0x7fcea01dd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.067+0000 7fce8affd640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcea00b0010 0x7fcea01e0820 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.068+0000 7fce8affd640 1 --2- 172.21.15.87:0/490130088 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcea006d130 0x7fcea013b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.068+0000 7fce8affd640 1 -- 172.21.15.87:0/490130088 >> 172.21.15.87:0/490130088 conn(0x7fcea00b6630 msgr2=0x7fcea013cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.068+0000 7fce8affd640 1 -- 172.21.15.87:0/490130088 shutdown_connections 2024-05-09T07:54:47.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.068+0000 7fce8affd640 1 -- 172.21.15.87:0/490130088 wait complete. 2024-05-09T07:54:47.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 -- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a1c06be30 msgr2=0x7f1a1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a1c06be30 0x7f1a1c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a300075b0 tx=0x7f1a30007540 comp rx=0 tx=0).stop 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 -- 172.21.15.87:0/2435870338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380b39d0 msgr2=0x7f1a381f2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380b39d0 0x7f1a381f2780 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400c4d0 tx=0x7f1a3400c990 comp rx=0 tx=0).stop 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 -- 172.21.15.87:0/2435870338 shutdown_connections 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a1c06be30 0x7f1a1c06e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a380b39d0 0x7f1a381f2780 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a380add80 0x7f1a3809b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 --2- 172.21.15.87:0/2435870338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a3808ba70 0x7f1a3809ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.069+0000 7f1a1bfff640 1 -- 172.21.15.87:0/2435870338 >> 172.21.15.87:0/2435870338 conn(0x7f1a380b5590 msgr2=0x7f1a3814e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.070+0000 7f1a1bfff640 1 -- 172.21.15.87:0/2435870338 shutdown_connections 2024-05-09T07:54:47.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.070+0000 7f1a1bfff640 1 -- 172.21.15.87:0/2435870338 wait complete. 2024-05-09T07:54:47.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.076+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f48b4005850 con 0x7f48cc0c4840 2024-05-09T07:54:47.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.076+0000 7f48d0ff9640 1 -- 172.21.15.87:0/2049170489 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f48d40dd850 con 0x7f48cc0c4840 2024-05-09T07:54:47.094 INFO:teuthology.orchestra.run.smithi087.stdout:55834574854 2024-05-09T07:54:47.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f48b806be30 msgr2=0x7f48b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f48b806be30 0x7f48b806e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f48c80090b0 tx=0x7f48c802e000 comp rx=0 tx=0).stop 2024-05-09T07:54:47.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc0c4840 msgr2=0x7f48cc03c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc0c4840 0x7f48cc03c8f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f48d4064d50 tx=0x7f48d4068700 comp rx=0 tx=0).stop 2024-05-09T07:54:47.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 shutdown_connections 2024-05-09T07:54:47.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f48b806be30 0x7f48b806e2f0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f48c80090b0 tx=0x7f48c802e000 comp rx=0 tx=0).stop 2024-05-09T07:54:47.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48cc0c4840 0x7f48cc03c8f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f48cc039780 0x7f48cc0c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 --2- 172.21.15.87:0/2049170489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48cc038390 0x7f48cc0c00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 >> 172.21.15.87:0/2049170489 conn(0x7f48cc008680 msgr2=0x7f48cc037160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:47.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 shutdown_connections 2024-05-09T07:54:47.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.081+0000 7f48d91dd640 1 -- 172.21.15.87:0/2049170489 wait complete. 2024-05-09T07:54:47.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.083+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9818005580 con 0x7f983015d240 2024-05-09T07:54:47.098 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.083+0000 7f1dbd7fa640 1 -- 172.21.15.87:0/185981896 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1db0005850 con 0x7f1dd8071430 2024-05-09T07:54:47.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.084+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f85100b6f70 con 0x7f85100b31c0 2024-05-09T07:54:47.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.084+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3cf0005580 con 0x7f3d00038ce0 2024-05-09T07:54:47.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.084+0000 7f9834ff9640 1 -- 172.21.15.87:0/1861725330 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f982405cd40 con 0x7f983015d240 2024-05-09T07:54:47.099 INFO:teuthology.orchestra.run.smithi087.stdout:55834574854 2024-05-09T07:54:47.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.084+0000 7f1dbf7fe640 1 -- 172.21.15.87:0/185981896 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1dd005a220 con 0x7f1dd8071430 2024-05-09T07:54:47.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.084+0000 7f3cfe7fc640 1 -- 172.21.15.87:0/3855730043 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d0405ce40 con 0x7f3d00038ce0 2024-05-09T07:54:47.100 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-05-09T07:54:47.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.084+0000 7f850d7fa640 1 -- 172.21.15.87:0/2249550036 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85000ab090 con 0x7f85100b31c0 2024-05-09T07:54:47.101 INFO:teuthology.orchestra.run.smithi087.stdout:55834574854 2024-05-09T07:54:47.101 INFO:teuthology.orchestra.run.smithi087.stdout:55834574853 2024-05-09T07:54:47.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.086+0000 7fc4bf7fe640 1 -- 172.21.15.87:0/1494524750 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc4d406f570 con 0x7fc4c00037a0 2024-05-09T07:54:47.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.0 2024-05-09T07:54:47.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.086+0000 7fc4c5ffb640 1 -- 172.21.15.87:0/1494524750 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc4cc05a480 con 0x7fc4c00037a0 2024-05-09T07:54:47.103 INFO:teuthology.orchestra.run.smithi087.stdout:60129542150 2024-05-09T07:54:47.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.087+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f981c06bf30 msgr2=0x7f981c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f981c06bf30 0x7f981c06e3f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f982c019f90 tx=0x7f982c008040 comp rx=0 tx=0).stop 2024-05-09T07:54:47.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f983015d240 msgr2=0x7f983015d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f983015d240 0x7f983015d6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9824001580 tx=0x7f9824001a40 comp rx=0 tx=0).stop 2024-05-09T07:54:47.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 shutdown_connections 2024-05-09T07:54:47.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f981c06bf30 0x7f981c06e3f0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f982c019f90 tx=0x7f982c008040 comp rx=0 tx=0).stop 2024-05-09T07:54:47.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f98301607b0 0x7f9830160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f983015d240 0x7f983015d6c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 --2- 172.21.15.87:0/1861725330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9830035630 0x7f98300c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 -- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1dc406bf00 msgr2=0x7f1dc406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 >> 172.21.15.87:0/1861725330 conn(0x7f983003ac20 msgr2=0x7f98300c11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:47.105 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1dc406bf00 0x7f1dc406e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc034000 tx=0x7f1dcc02e000 comp rx=0 tx=0).stop 2024-05-09T07:54:47.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 -- 172.21.15.87:0/185981896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd8071430 msgr2=0x7f1dd8139c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f84f006be30 msgr2=0x7f84f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f851646b640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f84f006be30 0x7f84f006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f851014a430 tx=0x7f84f8009040 comp rx=0 tx=0).stop 2024-05-09T07:54:47.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd8071430 0x7f1dd8139c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80b6a00 tx=0x7f1dd0007700 comp rx=0 tx=0).stop 2024-05-09T07:54:47.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85100b31c0 msgr2=0x7f85100725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f851646b640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85100b31c0 0x7f85100725f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85000097a0 tx=0x7f85000046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 -- 172.21.15.87:0/185981896 shutdown_connections 2024-05-09T07:54:47.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1dc406bf00 0x7f1dc406e3c0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc034000 tx=0x7f1dcc02e000 comp rx=0 tx=0).stop 2024-05-09T07:54:47.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd8071430 0x7f1dd8139c10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 shutdown_connections 2024-05-09T07:54:47.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1dd8141390 0x7f1dd8143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 --2- 172.21.15.87:0/185981896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc0007dc0 0x7f1dd81465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f1dbd7fa640 1 -- 172.21.15.87:0/185981896 >> 172.21.15.87:0/185981896 conn(0x7f1dd80b5650 msgr2=0x7f1dd806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:47.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f983e8bd640 1 -- 172.21.15.87:0/1861725330 wait complete. 2024-05-09T07:54:47.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3cec06be30 msgr2=0x7f3cec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3cec06be30 0x7f3cec06e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009f30 tx=0x7f3cf8009190 comp rx=0 tx=0).stop 2024-05-09T07:54:47.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 shutdown_connections 2024-05-09T07:54:47.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f851646b640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f84f006be30 0x7f84f006e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f1dbd7fa640 1 -- 172.21.15.87:0/185981896 shutdown_connections 2024-05-09T07:54:47.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f1dbd7fa640 1 -- 172.21.15.87:0/185981896 wait complete. 2024-05-09T07:54:47.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00038ce0 msgr2=0x7f3d001696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00038ce0 0x7f3d001696d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400e8d0 tx=0x7f3d0400ed90 comp rx=0 tx=0).stop 2024-05-09T07:54:47.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f851646b640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f851014c880 0x7f8510070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f851646b640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100b6130 0x7f8510071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.088+0000 7f851646b640 1 --2- 172.21.15.87:0/2249550036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85100b31c0 0x7f85100725f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 >> 172.21.15.87:0/2249550036 conn(0x7f8510067380 msgr2=0x7f851014a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:47.111 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 shutdown_connections 2024-05-09T07:54:47.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3cec06be30 0x7f3cec06e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d00038ce0 0x7f3d001696d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 shutdown_connections 2024-05-09T07:54:47.112 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f851646b640 1 -- 172.21.15.87:0/2249550036 wait complete. 2024-05-09T07:54:47.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d0003b130 0x7f3d000d2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f3d0e8f8640 1 --2- 172.21.15.87:0/3855730043 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3d00006d20 0x7f3d000d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 >> 172.21.15.87:0/3855730043 conn(0x7f3d000086e0 msgr2=0x7f3d000c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:47.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 shutdown_connections 2024-05-09T07:54:47.113 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.089+0000 7f3d0e8f8640 1 -- 172.21.15.87:0/3855730043 wait complete. 2024-05-09T07:54:47.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-05-09T07:54:47.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 -- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc4b806be30 msgr2=0x7fc4b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc4b806be30 0x7fc4b806e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0033000 tx=0x7fc4d0035040 comp rx=0 tx=0).stop 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 -- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 msgr2=0x7fc4d4146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4d4146020 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0046e0 tx=0x7fc4cc0077c0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 -- 172.21.15.87:0/1494524750 shutdown_connections 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc4b806be30 0x7fc4b806e2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4d4135ab0 0x7fc4d4135f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4d4072450 0x7fc4d41e49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 --2- 172.21.15.87:0/1494524750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc4c00037a0 0x7fc4d4146020 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0046e0 tx=0x7fc4cc0077c0 comp rx=0 tx=0).stop 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.090+0000 7fc4bf7fe640 1 -- 172.21.15.87:0/1494524750 >> 172.21.15.87:0/1494524750 conn(0x7fc4d40b5860 msgr2=0x7fc4d40b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.091+0000 7fc4bf7fe640 1 -- 172.21.15.87:0/1494524750 shutdown_connections 2024-05-09T07:54:47.115 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:47.091+0000 7fc4bf7fe640 1 -- 172.21.15.87:0/1494524750 wait complete. 2024-05-09T07:54:47.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-05-09T07:54:47.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-05-09T07:54:47.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-05-09T07:54:47.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.1 2024-05-09T07:54:47.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-05-09T07:54:47.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-05-09T07:54:48.104 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T07:54:48.114 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T07:54:48.119 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T07:54:48.121 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T07:54:48.121 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T07:54:48.125 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T07:54:48.126 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T07:54:48.127 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T07:54:48.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.251+0000 7fe79488b640 1 Processor -- start 2024-05-09T07:54:48.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.251+0000 7fe79488b640 1 -- start start 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.252+0000 7fe79488b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7900adfc0 0x7fe7900aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.252+0000 7fe79488b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe79006db10 0x7fe79008b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.252+0000 7fe79488b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7900ae3a0 con 0x7fe79008b510 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.252+0000 7fe79488b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe79006df70 con 0x7fe79006db10 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.252+0000 7fe79488b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe7900b4d30 con 0x7fe7900adfc0 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.253+0000 7fe78e59c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe79008b510 0x7fe79006d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43664/0 (socket says 172.21.15.87:43664) 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.253+0000 7fe78e59c640 1 -- 172.21.15.87:0/1861752454 learned_addr learned my addr 172.21.15.87:0/1861752454 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.253+0000 7fe78f59e640 1 --2- 172.21.15.87:0/1861752454 >> v2:172.21.15.110:3300/0 conn(0x7fe79006db10 0x7fe79008b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.253+0000 7fe78ed9d640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7900adfc0 0x7fe7900aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.254+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349546792 0 0) 0x7fe7900ae3a0 con 0x7fe79008b510 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.254+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe778003520 con 0x7fe79008b510 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.254+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1233100708 0 0) 0x7fe778003520 con 0x7fe79008b510 2024-05-09T07:54:48.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.254+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7900adfc0 msgr2=0x7fe7900aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.254+0000 7fe78dd9b640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7900adfc0 0x7fe7900aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.254+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 >> v2:172.21.15.110:3300/0 conn(0x7fe79006db10 msgr2=0x7fe79008b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.254+0000 7fe78dd9b640 1 --2- 172.21.15.87:0/1861752454 >> v2:172.21.15.110:3300/0 conn(0x7fe79006db10 0x7fe79008b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.254+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7900af350 con 0x7fe79008b510 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.255+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7fe780001310 con 0x7fe79008b510 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.255+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 >> v1:172.21.15.87:6789/0 conn(0x7fe79008b510 legacy=0x7fe79006d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.255+0000 7fe78dd9b640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe778003a30 0x7fe778003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.255+0000 7fe78dd9b640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe778004800 0x7fe778004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.255+0000 7fe78dd9b640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7780051c0 0x7fe77800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.255+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe79006df70 con 0x7fe7780051c0 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.255+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe7900b4d30 con 0x7fe778003a30 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.255+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe77800c140 con 0x7fe778004800 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.256+0000 7fe78ed9d640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7900adfc0 0x7fe7900aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:48.272 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.256+0000 7fe78e59c640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe778004800 0x7fe778004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.256+0000 7fe78ed9d640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe778003a30 0x7fe778003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.256+0000 7fe78f59e640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7780051c0 0x7fe77800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.273 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.257+0000 7fe78e59c640 1 -- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe778003a30 msgr2=0x7fe778003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.257+0000 7fe78e59c640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe778003a30 0x7fe778003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.257+0000 7fe78e59c640 1 -- 172.21.15.87:0/1861752454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7780051c0 msgr2=0x7fe77800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.257+0000 7fe78e59c640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7780051c0 0x7fe77800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.257+0000 7fe78e59c640 1 -- 172.21.15.87:0/1861752454 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe778003520 con 0x7fe778004800 2024-05-09T07:54:48.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.257+0000 7fe78f59e640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7780051c0 0x7fe77800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:48.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.258+0000 7fe78ed9d640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe778003a30 0x7fe778003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:48.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.258+0000 7fe78e59c640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe778004800 0x7fe778004c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe78000a9f0 tx=0x7fe778005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ae43dcdf1cc95e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.258+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78000a610 con 0x7fe778004800 2024-05-09T07:54:48.274 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.258+0000 7fe78dd9b640 1 -- 172.21.15.87:0/1861752454 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78002f030 con 0x7fe778004800 2024-05-09T07:54:48.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.259+0000 7fe79488b640 1 -- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe778004800 msgr2=0x7fe778004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.259+0000 7fe79488b640 1 --2- 172.21.15.87:0/1861752454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe778004800 0x7fe778004c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe78000a9f0 tx=0x7fe778005830 comp rx=0 tx=0).stop 2024-05-09T07:54:48.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.260+0000 7fe78f59e640 1 -- 172.21.15.87:0/1861752454 reap_dead start 2024-05-09T07:54:48.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.260+0000 7fe79488b640 1 -- 172.21.15.87:0/1861752454 shutdown_connections 2024-05-09T07:54:48.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.260+0000 7fe79488b640 1 -- 172.21.15.87:0/1861752454 >> 172.21.15.87:0/1861752454 conn(0x7fe7900b5650 msgr2=0x7fe7900b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.260+0000 7fe79488b640 1 -- 172.21.15.87:0/1861752454 shutdown_connections 2024-05-09T07:54:48.279 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.260+0000 7fe79488b640 1 -- 172.21.15.87:0/1861752454 wait complete. 2024-05-09T07:54:48.283 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.262+0000 7fe79488b640 1 Processor -- start 2024-05-09T07:54:48.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.262+0000 7fe79488b640 1 -- start start 2024-05-09T07:54:48.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.263+0000 7fe79488b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79009acb0 0x7fe7901e9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.263+0000 7fe79488b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79009d750 0x7fe7901e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.263+0000 7fe79488b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe79008a570 0x7fe79008aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.263+0000 7fe79488b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe7900aea10 con 0x7fe79008a570 2024-05-09T07:54:48.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.263+0000 7fe79488b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe7900b4a40 con 0x7fe79009acb0 2024-05-09T07:54:48.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.263+0000 7fe79488b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe7900b5200 con 0x7fe79009d750 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.264+0000 7fe78f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe79008a570 0x7fe79008aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.264+0000 7fe78f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe79008a570 0x7fe79008aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55856/0 (socket says 172.21.15.87:55856) 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.264+0000 7fe78f59e640 1 -- 172.21.15.87:0/731976539 learned_addr learned my addr 172.21.15.87:0/731976539 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.264+0000 7fe78f59e640 1 -- 172.21.15.87:0/731976539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79009d750 msgr2=0x7fe7901e9cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.264+0000 7fe78f59e640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79009d750 0x7fe7901e9cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.264+0000 7fe78f59e640 1 -- 172.21.15.87:0/731976539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79009acb0 msgr2=0x7fe7901e9780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.264+0000 7fe78f59e640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79009acb0 0x7fe7901e9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.264+0000 7fe78f59e640 1 -- 172.21.15.87:0/731976539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79009c2e0 con 0x7fe79008a570 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.264+0000 7fe78f59e640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe79008a570 0x7fe79008aa20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe7900b2a40 tx=0x7fe78800e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.265+0000 7fe7777fe640 1 -- 172.21.15.87:0/731976539 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78800bc10 con 0x7fe79008a570 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.265+0000 7fe7777fe640 1 -- 172.21.15.87:0/731976539 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe788003990 con 0x7fe79008a570 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.265+0000 7fe7777fe640 1 -- 172.21.15.87:0/731976539 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788003d40 con 0x7fe79008a570 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.265+0000 7fe79488b640 1 -- 172.21.15.87:0/731976539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe790072220 con 0x7fe79008a570 2024-05-09T07:54:48.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.265+0000 7fe79488b640 1 -- 172.21.15.87:0/731976539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79009d2c0 con 0x7fe79008a570 2024-05-09T07:54:48.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.269+0000 7fe7777fe640 1 -- 172.21.15.87:0/731976539 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe78801f030 con 0x7fe79008a570 2024-05-09T07:54:48.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.270+0000 7fe7757fa640 1 -- 172.21.15.87:0/731976539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7900756c0 con 0x7fe79008a570 2024-05-09T07:54:48.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.280+0000 7fe7777fe640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe77c06be60 0x7fe77c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.281+0000 7fe78ed9d640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe77c06be60 0x7fe77c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.281+0000 7fe78ed9d640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe77c06be60 0x7fe77c06e320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe784006fd0 tx=0x7fe784008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.282+0000 7fe7777fe640 1 -- 172.21.15.87:0/731976539 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe78808a950 con 0x7fe79008a570 2024-05-09T07:54:48.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.282+0000 7fe7777fe640 1 -- 172.21.15.87:0/731976539 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe788026060 con 0x7fe79008a570 2024-05-09T07:54:48.327 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.313+0000 7fa68c8c6640 1 Processor -- start 2024-05-09T07:54:48.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.312+0000 7f733624d640 1 Processor -- start 2024-05-09T07:54:48.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.312+0000 7f1322c14640 1 Processor -- start 2024-05-09T07:54:48.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.313+0000 7f1322c14640 1 -- start start 2024-05-09T07:54:48.328 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.313+0000 7ff802f89640 1 Processor -- start 2024-05-09T07:54:48.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.313+0000 7ff802f89640 1 -- start start 2024-05-09T07:54:48.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.313+0000 7fa68c8c6640 1 -- start start 2024-05-09T07:54:48.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa68c8c6640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa68003b040 0x7fa68003bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa68c8c6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6800c6270 0x7fa6800c6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa68c8c6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68003b420 con 0x7fa68003c800 2024-05-09T07:54:48.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa68c8c6640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa6800cc7f0 con 0x7fa68003b040 2024-05-09T07:54:48.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa68c8c6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa6800ccad0 con 0x7fa6800c6270 2024-05-09T07:54:48.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa687fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6800c6270 0x7fa6800c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa687fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6800c6270 0x7fa6800c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47828/0 (socket says 172.21.15.87:47828) 2024-05-09T07:54:48.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa687fff640 1 -- 172.21.15.87:0/2035273284 learned_addr learned my addr 172.21.15.87:0/2035273284 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa6877fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa68003b040 0x7fa68003bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa687fff640 1 -- 172.21.15.87:0/2035273284 >> v2:172.21.15.87:3300/0 conn(0x7fa68003b040 msgr2=0x7fa68003bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.312+0000 7f733624d640 1 -- start start 2024-05-09T07:54:48.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f733624d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f733014ca70 0x7f7330066f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f733624d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73300b3f20 0x7f7330156690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f733624d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f733014bf90 con 0x7f7330146360 2024-05-09T07:54:48.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f733624d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f733014c270 con 0x7f733014ca70 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f733624d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f733014c550 con 0x7f73300b3f20 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f732f7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7330146360 0x7f733009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:51502/0 (socket says 172.21.15.87:51502) 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f732f7fe640 1 -- 172.21.15.87:0/430523685 learned_addr learned my addr 172.21.15.87:0/430523685 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f732ffff640 1 --2- 172.21.15.87:0/430523685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73300b3f20 0x7f7330156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f7327fff640 1 --2- 172.21.15.87:0/430523685 >> v2:172.21.15.87:3300/0 conn(0x7f733014ca70 0x7f7330066f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1322c14640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1314038880 0x7f131403a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1322c14640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f13140cc780 0x7f13140c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1322c14640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13140395b0 con 0x7f13140ccbc0 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1322c14640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f131403a910 con 0x7f13140cc780 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1322c14640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f131403acd0 con 0x7f1314038880 2024-05-09T07:54:48.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1321c12640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1314038880 0x7f131403a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1322413640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f13140ccbc0 0x7f13140c6960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43672/0 (socket says 172.21.15.87:43672) 2024-05-09T07:54:48.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1322413640 1 -- 172.21.15.87:0/3781445949 learned_addr learned my addr 172.21.15.87:0/3781445949 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:48.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7ff800d25640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff7fc0b6540 0x7ff7fc0b4990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43674/0 (socket says 172.21.15.87:43674) 2024-05-09T07:54:48.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.313+0000 7f1530109640 1 Processor -- start 2024-05-09T07:54:48.332 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.313+0000 7f1530109640 1 -- start start 2024-05-09T07:54:48.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1530109640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f15280b5420 0x7f1528148e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7f1530109640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b44e0 0x7f15281564f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f1530109640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15280b5800 con 0x7f15280bdc00 2024-05-09T07:54:48.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f1530109640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f152814bc50 con 0x7f15280b5420 2024-05-09T07:54:48.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f1530109640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f15280b5c10 con 0x7f15280b44e0 2024-05-09T07:54:48.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f152e6a6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b44e0 0x7f15281564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f152e6a6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b44e0 0x7f15281564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47852/0 (socket says 172.21.15.87:47852) 2024-05-09T07:54:48.333 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f152e6a6640 1 -- 172.21.15.87:0/4144531301 learned_addr learned my addr 172.21.15.87:0/4144531301 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7ff802f89640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff7fc0b3fb0 0x7ff7fc0b4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7ff802f89640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7fc0b6920 con 0x7ff7fc0b6540 2024-05-09T07:54:48.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7ff802f89640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7fc072ce0 con 0x7ff7fc13d890 2024-05-09T07:54:48.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7ff802f89640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff7fc073330 con 0x7ff7fc0b3fb0 2024-05-09T07:54:48.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7ff800d25640 1 -- 172.21.15.87:0/2380916627 learned_addr learned my addr 172.21.15.87:0/2380916627 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:48.334 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.314+0000 7fa687fff640 1 --2- 172.21.15.87:0/2035273284 >> v2:172.21.15.87:3300/0 conn(0x7fa68003b040 0x7fa68003bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f1321411640 1 --2- 172.21.15.87:0/3781445949 >> v2:172.21.15.87:3300/0 conn(0x7f13140cc780 0x7f13140c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f1321c12640 1 -- 172.21.15.87:0/3781445949 >> v2:172.21.15.87:3300/0 conn(0x7f13140cc780 msgr2=0x7f13140c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f1321c12640 1 --2- 172.21.15.87:0/3781445949 >> v2:172.21.15.87:3300/0 conn(0x7f13140cc780 0x7f13140c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f1321c12640 1 -- 172.21.15.87:0/3781445949 >> v1:172.21.15.87:6789/0 conn(0x7f13140ccbc0 legacy=0x7f13140c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f1321c12640 1 -- 172.21.15.87:0/3781445949 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1314038c60 con 0x7f1314038880 2024-05-09T07:54:48.335 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7ff7fbfff640 1 --2- 172.21.15.87:0/2380916627 >> v2:172.21.15.110:3300/0 conn(0x7ff7fc0b3fb0 0x7ff7fc0b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f152e6a6640 1 -- 172.21.15.87:0/4144531301 >> v2:172.21.15.87:3300/0 conn(0x7f15280b5420 msgr2=0x7f1528148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f152e6a6640 1 --2- 172.21.15.87:0/4144531301 >> v2:172.21.15.87:3300/0 conn(0x7f15280b5420 0x7f1528148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f152e6a6640 1 -- 172.21.15.87:0/4144531301 >> v1:172.21.15.87:6789/0 conn(0x7f15280bdc00 legacy=0x7f152814c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f152e6a6640 1 -- 172.21.15.87:0/4144531301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15280b5ef0 con 0x7f15280b44e0 2024-05-09T07:54:48.336 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2012967152 0 0) 0x7ff7fc0b6920 con 0x7ff7fc0b6540 2024-05-09T07:54:48.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7fa687fff640 1 -- 172.21.15.87:0/2035273284 >> v1:172.21.15.110:6789/0 conn(0x7fa68003c800 legacy=0x7fa6800ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7fa687fff640 1 -- 172.21.15.87:0/2035273284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6800c6bb0 con 0x7fa6800c6270 2024-05-09T07:54:48.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7ec003520 con 0x7ff7fc0b6540 2024-05-09T07:54:48.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633161081 0 0) 0x7ff7fc072ce0 con 0x7ff7fc13d890 2024-05-09T07:54:48.337 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7fc0b6920 con 0x7ff7fc13d890 2024-05-09T07:54:48.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f732effd640 1 -- 172.21.15.87:0/430523685 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2512968804 0 0) 0x7f733014bf90 con 0x7f7330146360 2024-05-09T07:54:48.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f732effd640 1 -- 172.21.15.87:0/430523685 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f731c003520 con 0x7f7330146360 2024-05-09T07:54:48.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7f732ffff640 1 -- 172.21.15.87:0/430523685 >> v2:172.21.15.87:3300/0 conn(0x7f733014ca70 msgr2=0x7f7330066f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f732ffff640 1 --2- 172.21.15.87:0/430523685 >> v2:172.21.15.87:3300/0 conn(0x7f733014ca70 0x7f7330066f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f732ffff640 1 -- 172.21.15.87:0/430523685 >> v1:172.21.15.110:6789/0 conn(0x7f7330146360 legacy=0x7f733009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f732ffff640 1 -- 172.21.15.87:0/430523685 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73300674d0 con 0x7f73300b3f20 2024-05-09T07:54:48.338 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7fa687fff640 1 --2- 172.21.15.87:0/2035273284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6800c6270 0x7fa6800c6670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa68806a280 tx=0x7fa6880a5e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=619dfc5c8fcff49d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4158826025 0 0) 0x7ff7ec003520 con 0x7ff7fc0b6540 2024-05-09T07:54:48.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 >> v2:172.21.15.110:3300/0 conn(0x7ff7fc0b3fb0 msgr2=0x7ff7fc0b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.339 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 --2- 172.21.15.87:0/2380916627 >> v2:172.21.15.110:3300/0 conn(0x7ff7fc0b3fb0 0x7ff7fc0b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 >> v1:172.21.15.110:6789/0 conn(0x7ff7fc13d890 legacy=0x7ff7fc14e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7fc072fc0 con 0x7ff7fc0b6540 2024-05-09T07:54:48.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f7327fff640 1 --2- 172.21.15.87:0/430523685 >> v2:172.21.15.87:3300/0 conn(0x7f733014ca70 0x7f7330066f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:48.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f1321c12640 1 --2- 172.21.15.87:0/3781445949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1314038880 0x7f131403a3d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f13180097a0 tx=0x7f131802a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b0195517ddf3198 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.340 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7ff7f0001670 con 0x7ff7fc0b6540 2024-05-09T07:54:48.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7fa6867fc640 1 -- 172.21.15.87:0/2035273284 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6880b3070 con 0x7fa6800c6270 2024-05-09T07:54:48.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 >> v1:172.21.15.87:6789/0 conn(0x7ff7fc0b6540 legacy=0x7ff7fc0b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.341 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f13a2d96640 1 Processor -- start 2024-05-09T07:54:48.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7fa6867fc640 1 -- 172.21.15.87:0/2035273284 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6880a6c30 con 0x7fa6800c6270 2024-05-09T07:54:48.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7fa6867fc640 1 -- 172.21.15.87:0/2035273284 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6880ae640 con 0x7fa6800c6270 2024-05-09T07:54:48.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7ff7fb7fe640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ec003b70 0x7ff7ec003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f1320c10640 1 -- 172.21.15.87:0/3781445949 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318037070 con 0x7f1314038880 2024-05-09T07:54:48.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f1320c10640 1 -- 172.21.15.87:0/3781445949 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131802ac90 con 0x7f1314038880 2024-05-09T07:54:48.342 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f1320c10640 1 -- 172.21.15.87:0/3781445949 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318032640 con 0x7f1314038880 2024-05-09T07:54:48.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff7fb7fe640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec004800 0x7ff7ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f732ffff640 1 --2- 172.21.15.87:0/430523685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73300b3f20 0x7f7330156690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7328009d90 tx=0x7f732802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db1c0b0a2fc501c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff7fb7fe640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7ec0051c0 0x7ff7ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.343 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff7fc073330 con 0x7ff7ec003b70 2024-05-09T07:54:48.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff7fbfff640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec004800 0x7ff7ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff800d25640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ec003b70 0x7ff7ec003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec00c0f0 con 0x7ff7ec004800 2024-05-09T07:54:48.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff801526640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7ec0051c0 0x7ff7ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec00c2f0 con 0x7ff7ec0051c0 2024-05-09T07:54:48.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f152e6a6640 1 --2- 172.21.15.87:0/4144531301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b44e0 0x7f15281564f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1520009e50 tx=0x7f152002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cded923f98862893 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.344 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7f13a2d96640 1 -- start start 2024-05-09T07:54:48.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.315+0000 7fba117a2640 1 Processor -- start 2024-05-09T07:54:48.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.316+0000 7fba117a2640 1 -- start start 2024-05-09T07:54:48.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7fba117a2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba0c0add80 0x7fba0c14fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7fba117a2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0c06d750 con 0x7fba0c14fa00 2024-05-09T07:54:48.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7fba117a2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0c0b0400 con 0x7fba0c0b4770 2024-05-09T07:54:48.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7fba117a2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fba0c0ae330 con 0x7fba0c0add80 2024-05-09T07:54:48.345 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff800d25640 1 -- 172.21.15.87:0/2380916627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7ec0051c0 msgr2=0x7ff7ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7fba0affd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fba0c14fa00 0x7fba0c0aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43702/0 (socket says 172.21.15.87:43702) 2024-05-09T07:54:48.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7fba0affd640 1 -- 172.21.15.87:0/3136650864 learned_addr learned my addr 172.21.15.87:0/3136650864 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:48.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7fba0a7fc640 1 --2- 172.21.15.87:0/3136650864 >> v2:172.21.15.110:3300/0 conn(0x7fba0c0add80 0x7fba0c14fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff800d25640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7ec0051c0 0x7ff7ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.346 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff800d25640 1 -- 172.21.15.87:0/2380916627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec004800 msgr2=0x7ff7ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff800d25640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec004800 0x7ff7ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff800d25640 1 -- 172.21.15.87:0/2380916627 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec003520 con 0x7ff7ec003b70 2024-05-09T07:54:48.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7ff801526640 1 -- 172.21.15.87:0/2380916627 reap_dead start 2024-05-09T07:54:48.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f152cea3640 1 -- 172.21.15.87:0/4144531301 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520036070 con 0x7f15280b44e0 2024-05-09T07:54:48.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f152cea3640 1 -- 172.21.15.87:0/4144531301 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1520031600 con 0x7f15280b44e0 2024-05-09T07:54:48.347 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f152cea3640 1 -- 172.21.15.87:0/4144531301 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15200319d0 con 0x7f15280b44e0 2024-05-09T07:54:48.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7fa68c8c6640 1 -- 172.21.15.87:0/2035273284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6800c6270 msgr2=0x7fa6800c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7fa68c8c6640 1 --2- 172.21.15.87:0/2035273284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6800c6270 0x7fa6800c6670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa68806a280 tx=0x7fa6880a5e40 comp rx=0 tx=0).stop 2024-05-09T07:54:48.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fa68c8c6640 1 -- 172.21.15.87:0/2035273284 shutdown_connections 2024-05-09T07:54:48.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fa68c8c6640 1 --2- 172.21.15.87:0/2035273284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6800c6270 0x7fa6800c6670 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fa68c8c6640 1 --2- 172.21.15.87:0/2035273284 >> v2:172.21.15.87:3300/0 conn(0x7fa68003b040 0x7fa68003bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fa68c8c6640 1 -- 172.21.15.87:0/2035273284 >> 172.21.15.87:0/2035273284 conn(0x7fa68003ed20 msgr2=0x7fa68003f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f13a2d96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c06ca50 0x7f139c0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f732effd640 1 -- 172.21.15.87:0/430523685 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328007740 con 0x7f73300b3f20 2024-05-09T07:54:48.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f732effd640 1 -- 172.21.15.87:0/430523685 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73280078e0 con 0x7f73300b3f20 2024-05-09T07:54:48.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f732effd640 1 -- 172.21.15.87:0/430523685 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328007cb0 con 0x7f73300b3f20 2024-05-09T07:54:48.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f1322c14640 1 -- 172.21.15.87:0/3781445949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1314038880 msgr2=0x7f131403a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.317+0000 7f1322c14640 1 --2- 172.21.15.87:0/3781445949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1314038880 0x7f131403a3d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f13180097a0 tx=0x7f131802a000 comp rx=0 tx=0).stop 2024-05-09T07:54:48.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fba09ffb640 1 -- 172.21.15.87:0/3136650864 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196805319 0 0) 0x7fba0c0b0400 con 0x7fba0c0b4770 2024-05-09T07:54:48.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fba09ffb640 1 -- 172.21.15.87:0/3136650864 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9f4003520 con 0x7fba0c0b4770 2024-05-09T07:54:48.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fba09ffb640 1 -- 172.21.15.87:0/3136650864 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139229919 0 0) 0x7fb9fc001110 con 0x7fba0c14fa00 2024-05-09T07:54:48.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fba09ffb640 1 -- 172.21.15.87:0/3136650864 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba0c0b0400 con 0x7fba0c14fa00 2024-05-09T07:54:48.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f1322c14640 1 -- 172.21.15.87:0/3781445949 shutdown_connections 2024-05-09T07:54:48.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f1322c14640 1 --2- 172.21.15.87:0/3781445949 >> v2:172.21.15.87:3300/0 conn(0x7f13140cc780 0x7f13140c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f1322c14640 1 --2- 172.21.15.87:0/3781445949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1314038880 0x7f131403a3d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f139bfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f139c0af170 0x7f139c146d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43704/0 (socket says 172.21.15.87:43704) 2024-05-09T07:54:48.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f1322c14640 1 -- 172.21.15.87:0/3781445949 >> 172.21.15.87:0/3781445949 conn(0x7f131403ea70 msgr2=0x7f131403ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.351 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f139bfff640 1 -- 172.21.15.87:0/4085944354 learned_addr learned my addr 172.21.15.87:0/4085944354 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:48.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fba0a7fc640 1 -- 172.21.15.87:0/3136650864 >> v1:172.21.15.110:6789/0 conn(0x7fba0c0b4770 legacy=0x7fba0c156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fba0a7fc640 1 -- 172.21.15.87:0/3136650864 >> v1:172.21.15.87:6789/0 conn(0x7fba0c14fa00 legacy=0x7fba0c0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fba0a7fc640 1 -- 172.21.15.87:0/3136650864 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c0ae610 con 0x7fba0c0add80 2024-05-09T07:54:48.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7ff7fbfff640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec004800 0x7ff7ec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:48.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f13a0b32640 1 --2- 172.21.15.87:0/4085944354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c06ca50 0x7f139c0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f13a2d96640 1 --2- 172.21.15.87:0/4085944354 >> v2:172.21.15.110:3300/0 conn(0x7f139c0b6080 0x7f139c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f13a2d96640 1 -- 172.21.15.87:0/4085944354 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f139c06ce30 con 0x7f139c0af170 2024-05-09T07:54:48.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f13a2d96640 1 -- 172.21.15.87:0/4085944354 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f139c0aece0 con 0x7f139c0b6080 2024-05-09T07:54:48.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f13a2d96640 1 -- 172.21.15.87:0/4085944354 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f139c0b0550 con 0x7f139c06ca50 2024-05-09T07:54:48.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f1322c14640 1 -- 172.21.15.87:0/3781445949 shutdown_connections 2024-05-09T07:54:48.353 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f139b7fe640 1 -- 172.21.15.87:0/4085944354 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495450789 0 0) 0x7f139c06ce30 con 0x7f139c0af170 2024-05-09T07:54:48.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7fa68c8c6640 1 -- 172.21.15.87:0/2035273284 shutdown_connections 2024-05-09T07:54:48.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f1322c14640 1 -- 172.21.15.87:0/3781445949 wait complete. 2024-05-09T07:54:48.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f13a1333640 1 --2- 172.21.15.87:0/4085944354 >> v2:172.21.15.110:3300/0 conn(0x7f139c0b6080 0x7f139c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f139b7fe640 1 -- 172.21.15.87:0/4085944354 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1384003520 con 0x7f139c0af170 2024-05-09T07:54:48.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7ff800d25640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ec003b70 0x7ff7ec003f50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0005020 tx=0x7ff7ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2568c6d0ee071516 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f1530109640 1 -- 172.21.15.87:0/4144531301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b44e0 msgr2=0x7f15281564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f13a0b32640 1 -- 172.21.15.87:0/4085944354 >> v2:172.21.15.110:3300/0 conn(0x7f139c0b6080 msgr2=0x7f139c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f13a0b32640 1 --2- 172.21.15.87:0/4085944354 >> v2:172.21.15.110:3300/0 conn(0x7f139c0b6080 0x7f139c0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f13a0b32640 1 -- 172.21.15.87:0/4085944354 >> v1:172.21.15.87:6789/0 conn(0x7f139c0af170 legacy=0x7f139c146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f1530109640 1 --2- 172.21.15.87:0/4144531301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b44e0 0x7f15281564f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1520009e50 tx=0x7f152002a6d0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f13a0b32640 1 -- 172.21.15.87:0/4085944354 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c0ae450 con 0x7f139c06ca50 2024-05-09T07:54:48.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0004bf0 con 0x7ff7ec003b70 2024-05-09T07:54:48.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7fa68c8c6640 1 -- 172.21.15.87:0/2035273284 wait complete. 2024-05-09T07:54:48.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f733624d640 1 -- 172.21.15.87:0/430523685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73300b3f20 msgr2=0x7f7330156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.318+0000 7f733624d640 1 --2- 172.21.15.87:0/430523685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73300b3f20 0x7f7330156690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7328009d90 tx=0x7f732802a5f0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f733624d640 1 -- 172.21.15.87:0/430523685 shutdown_connections 2024-05-09T07:54:48.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f733624d640 1 --2- 172.21.15.87:0/430523685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73300b3f20 0x7f7330156690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f733624d640 1 --2- 172.21.15.87:0/430523685 >> v2:172.21.15.87:3300/0 conn(0x7f733014ca70 0x7f7330066f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f733624d640 1 -- 172.21.15.87:0/430523685 >> 172.21.15.87:0/430523685 conn(0x7f73300b6020 msgr2=0x7f73300b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f733624d640 1 -- 172.21.15.87:0/430523685 shutdown_connections 2024-05-09T07:54:48.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7f733624d640 1 -- 172.21.15.87:0/430523685 wait complete. 2024-05-09T07:54:48.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f002f030 con 0x7ff7ec003b70 2024-05-09T07:54:48.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.319+0000 7ff7fb7fe640 1 -- 172.21.15.87:0/2380916627 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0005d30 con 0x7ff7ec003b70 2024-05-09T07:54:48.359 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f1530109640 1 -- 172.21.15.87:0/4144531301 shutdown_connections 2024-05-09T07:54:48.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f1530109640 1 --2- 172.21.15.87:0/4144531301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b44e0 0x7f15281564f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f1530109640 1 --2- 172.21.15.87:0/4144531301 >> v2:172.21.15.87:3300/0 conn(0x7f15280b5420 0x7f1528148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f1530109640 1 -- 172.21.15.87:0/4144531301 >> 172.21.15.87:0/4144531301 conn(0x7f15280bd0e0 msgr2=0x7f15280bd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7ff802f89640 1 -- 172.21.15.87:0/2380916627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ec003b70 msgr2=0x7ff7ec003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.360 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f1322c14640 1 Processor -- start 2024-05-09T07:54:48.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7ff802f89640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ec003b70 0x7ff7ec003f50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0005020 tx=0x7ff7ec005830 comp rx=0 tx=0).stop 2024-05-09T07:54:48.361 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7fba0a7fc640 1 --2- 172.21.15.87:0/3136650864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba0c0add80 0x7fba0c14fde0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba04009d90 tx=0x7fba0402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12fcf43d6e1a6768 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f733624d640 1 Processor -- start 2024-05-09T07:54:48.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7ff802f89640 1 -- 172.21.15.87:0/2380916627 shutdown_connections 2024-05-09T07:54:48.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7ff802f89640 1 --2- 172.21.15.87:0/2380916627 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7ec003b70 0x7ff7ec003f50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7ff802f89640 1 -- 172.21.15.87:0/2380916627 >> 172.21.15.87:0/2380916627 conn(0x7ff7fc0b96f0 msgr2=0x7ff7fc0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f13a0b32640 1 --2- 172.21.15.87:0/4085944354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c06ca50 0x7f139c0b3490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f139000c440 tx=0x7f139002b2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4d35b31aceddb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f1322c14640 1 -- start start 2024-05-09T07:54:48.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7ff802f89640 1 -- 172.21.15.87:0/2380916627 shutdown_connections 2024-05-09T07:54:48.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7ff802f89640 1 -- 172.21.15.87:0/2380916627 wait complete. 2024-05-09T07:54:48.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f1530109640 1 -- 172.21.15.87:0/4144531301 shutdown_connections 2024-05-09T07:54:48.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f1530109640 1 -- 172.21.15.87:0/4144531301 wait complete. 2024-05-09T07:54:48.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7fa68c8c6640 1 Processor -- start 2024-05-09T07:54:48.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.320+0000 7f733624d640 1 -- start start 2024-05-09T07:54:48.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7fba09ffb640 1 -- 172.21.15.87:0/3136650864 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04007740 con 0x7fba0c0add80 2024-05-09T07:54:48.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7fa68c8c6640 1 -- start start 2024-05-09T07:54:48.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7fba09ffb640 1 -- 172.21.15.87:0/3136650864 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba040078e0 con 0x7fba0c0add80 2024-05-09T07:54:48.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7fba09ffb640 1 -- 172.21.15.87:0/3136650864 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04007cb0 con 0x7fba0c0add80 2024-05-09T07:54:48.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7f733624d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73300b3f20 0x7f733009d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7f1322c14640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1314038880 0x7f13140c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7f733624d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7330146360 0x7f7330070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.366 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7f733624d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f733014ca70 0x7f73300712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7f1321c12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1314038880 0x7f13140c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f1321c12640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1314038880 0x7f13140c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55904/0 (socket says 172.21.15.87:55904) 2024-05-09T07:54:48.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f1321c12640 1 -- 172.21.15.87:0/838446807 learned_addr learned my addr 172.21.15.87:0/838446807 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f1322c14640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13140cc780 0x7f13140c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f1322c14640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13140ccbc0 0x7f13140cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f131403b160 con 0x7f1314038880 2024-05-09T07:54:48.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fba117a2640 1 -- 172.21.15.87:0/3136650864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba0c0add80 msgr2=0x7fba0c14fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fba117a2640 1 --2- 172.21.15.87:0/3136650864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba0c0add80 0x7fba0c14fde0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba04009d90 tx=0x7fba0402a660 comp rx=0 tx=0).stop 2024-05-09T07:54:48.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1314039850 con 0x7f13140ccbc0 2024-05-09T07:54:48.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f13140c7e90 con 0x7f13140cc780 2024-05-09T07:54:48.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fba117a2640 1 -- 172.21.15.87:0/3136650864 shutdown_connections 2024-05-09T07:54:48.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fba117a2640 1 --2- 172.21.15.87:0/3136650864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba0c0add80 0x7fba0c14fde0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fba117a2640 1 -- 172.21.15.87:0/3136650864 >> 172.21.15.87:0/3136650864 conn(0x7fba0c0b5860 msgr2=0x7fba0c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fba117a2640 1 -- 172.21.15.87:0/3136650864 shutdown_connections 2024-05-09T07:54:48.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f1530109640 1 Processor -- start 2024-05-09T07:54:48.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fa68c8c6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa68003b040 0x7fa6800c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fa68c8c6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa68003c800 0x7fa680165820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f1530109640 1 -- start start 2024-05-09T07:54:48.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fa68c8c6640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6800c6270 0x7fa6800bf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f732ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f733014ca70 0x7f73300712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f733624d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f73300b4530 con 0x7f733014ca70 2024-05-09T07:54:48.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f732ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f733014ca70 0x7f73300712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55920/0 (socket says 172.21.15.87:55920) 2024-05-09T07:54:48.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f732ffff640 1 -- 172.21.15.87:0/1221029776 learned_addr learned my addr 172.21.15.87:0/1221029776 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f73300b43b0 con 0x7f73300b3f20 2024-05-09T07:54:48.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f7330156bd0 con 0x7f7330146360 2024-05-09T07:54:48.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fa68c8c6640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa68003a810 con 0x7fa6800c6270 2024-05-09T07:54:48.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7ff802f89640 1 Processor -- start 2024-05-09T07:54:48.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fba117a2640 1 -- 172.21.15.87:0/3136650864 wait complete. 2024-05-09T07:54:48.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fa68c8c6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa68003a690 con 0x7fa68003c800 2024-05-09T07:54:48.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7ff802f89640 1 -- start start 2024-05-09T07:54:48.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7fa68c8c6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa6800d6f60 con 0x7fa68003b040 2024-05-09T07:54:48.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa687fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6800c6270 0x7fa6800bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa687fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6800c6270 0x7fa6800bf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55934/0 (socket says 172.21.15.87:55934) 2024-05-09T07:54:48.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa687fff640 1 -- 172.21.15.87:0/2577205483 learned_addr learned my addr 172.21.15.87:0/2577205483 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f732ffff640 1 -- 172.21.15.87:0/1221029776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7330146360 msgr2=0x7f7330070d70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T07:54:48.373 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f732ffff640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7330146360 0x7f7330070d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f732ffff640 1 -- 172.21.15.87:0/1221029776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73300b3f20 msgr2=0x7f733009d140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T07:54:48.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f732ffff640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73300b3f20 0x7f733009d140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f732ffff640 1 -- 172.21.15.87:0/1221029776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733009ee80 con 0x7f733014ca70 2024-05-09T07:54:48.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1321411640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13140cc780 0x7f13140c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1321c12640 1 -- 172.21.15.87:0/838446807 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13140cc780 msgr2=0x7f13140c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1321c12640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13140cc780 0x7f13140c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1321c12640 1 -- 172.21.15.87:0/838446807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13140ccbc0 msgr2=0x7f13140cf640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T07:54:48.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1321c12640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13140ccbc0 0x7f13140cf640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1321c12640 1 -- 172.21.15.87:0/838446807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13140c7250 con 0x7f1314038880 2024-05-09T07:54:48.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa686ffd640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa68003c800 0x7fa680165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa6877fe640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa68003b040 0x7fa6800c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f732ffff640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f733014ca70 0x7f73300712b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f732802abe0 tx=0x7f7328004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.375 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1530109640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15280b44e0 0x7f15280b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa6877fe640 1 -- 172.21.15.87:0/2577205483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa68003c800 msgr2=0x7fa680165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa6877fe640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa68003c800 0x7fa680165820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa6877fe640 1 -- 172.21.15.87:0/2577205483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6800c6270 msgr2=0x7fa6800bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa6877fe640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6800c6270 0x7fa6800bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7fa6877fe640 1 -- 172.21.15.87:0/2577205483 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6800c05e0 con 0x7fa68003b040 2024-05-09T07:54:48.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1530109640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15280b5420 0x7f15280b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1530109640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b1030 0x7f152812ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f152dea5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15280b44e0 0x7f15280b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7f139b7fe640 1 -- 172.21.15.87:0/4085944354 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390038070 con 0x7f139c06ca50 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7f139b7fe640 1 -- 172.21.15.87:0/4085944354 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1390033440 con 0x7f139c06ca50 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.321+0000 7f139b7fe640 1 -- 172.21.15.87:0/4085944354 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390033810 con 0x7f139c06ca50 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f13a2d96640 1 -- 172.21.15.87:0/4085944354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c06ca50 msgr2=0x7f139c0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.322+0000 7f13a2d96640 1 --2- 172.21.15.87:0/4085944354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c06ca50 0x7f139c0b3490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f139000c440 tx=0x7f139002b2b0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f13a2d96640 1 -- 172.21.15.87:0/4085944354 shutdown_connections 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f13a2d96640 1 --2- 172.21.15.87:0/4085944354 >> v2:172.21.15.110:3300/0 conn(0x7f139c0b6080 0x7f139c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f13a2d96640 1 --2- 172.21.15.87:0/4085944354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c06ca50 0x7f139c0b3490 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f13a2d96640 1 -- 172.21.15.87:0/4085944354 >> 172.21.15.87:0/4085944354 conn(0x7f139c0b5590 msgr2=0x7f139c0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.377 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f732cff9640 1 -- 172.21.15.87:0/1221029776 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328040070 con 0x7f733014ca70 2024-05-09T07:54:48.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f1321c12640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1314038880 0x7f13140c8db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13180098c0 tx=0x7f13180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.323+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7330072a10 con 0x7f733014ca70 2024-05-09T07:54:48.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f733009eba0 con 0x7f733014ca70 2024-05-09T07:54:48.378 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f152e6a6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b1030 0x7f152812ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f732cff9640 1 -- 172.21.15.87:0/1221029776 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7328031b40 con 0x7f733014ca70 2024-05-09T07:54:48.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f152dea5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15280b44e0 0x7f15280b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55938/0 (socket says 172.21.15.87:55938) 2024-05-09T07:54:48.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f152e6a6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b1030 0x7f152812ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47908/0 (socket says 172.21.15.87:47908) 2024-05-09T07:54:48.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f152d6a4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15280b5420 0x7f15280b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f152dea5640 1 -- 172.21.15.87:0/1514889521 learned_addr learned my addr 172.21.15.87:0/1514889521 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f1530109640 1 -- 172.21.15.87:0/1514889521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f152814c9e0 con 0x7f15280b44e0 2024-05-09T07:54:48.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f1530109640 1 -- 172.21.15.87:0/1514889521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f152814c860 con 0x7f15280b5420 2024-05-09T07:54:48.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f1530109640 1 -- 172.21.15.87:0/1514889521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1528145bb0 con 0x7f15280b1030 2024-05-09T07:54:48.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7ff802f89640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec003b70 0x7ff7fc13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.380 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7fa6877fe640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa68003b040 0x7fa6800c9520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00d620 tx=0x7fa67c00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7ff802f89640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7fc146420 0x7ff7fc1468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7ff802f89640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7fc141760 0x7ff7fc141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7ff802f89640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff7fc0ae260 con 0x7ff7fc146420 2024-05-09T07:54:48.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7fba117a2640 1 Processor -- start 2024-05-09T07:54:48.381 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7fba117a2640 1 -- start start 2024-05-09T07:54:48.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7ff802f89640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff7fc0ae0e0 con 0x7ff7ec003b70 2024-05-09T07:54:48.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7ff802f89640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff7fc068330 con 0x7ff7fc141760 2024-05-09T07:54:48.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7ff800d25640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec003b70 0x7ff7fc13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7ff800d25640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec003b70 0x7ff7fc13c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:37878/0 (socket says 172.21.15.87:37878) 2024-05-09T07:54:48.382 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7ff800d25640 1 -- 172.21.15.87:0/1615311869 learned_addr learned my addr 172.21.15.87:0/1615311869 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7fa66ffff640 1 -- 172.21.15.87:0/2577205483 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00b620 con 0x7fa68003b040 2024-05-09T07:54:48.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7fa66ffff640 1 -- 172.21.15.87:0/2577205483 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67c019070 con 0x7fa68003b040 2024-05-09T07:54:48.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f732cff9640 1 -- 172.21.15.87:0/1221029776 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7328009450 con 0x7f733014ca70 2024-05-09T07:54:48.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f13127fc640 1 -- 172.21.15.87:0/838446807 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318037030 con 0x7f1314038880 2024-05-09T07:54:48.383 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13140c8aa0 con 0x7f1314038880 2024-05-09T07:54:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13140cfb80 con 0x7f1314038880 2024-05-09T07:54:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f152e6a6640 1 -- 172.21.15.87:0/1514889521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15280b5420 msgr2=0x7f15280b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f152e6a6640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15280b5420 0x7f15280b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.384 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f152e6a6640 1 -- 172.21.15.87:0/1514889521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15280b44e0 msgr2=0x7f15280b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f152e6a6640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15280b44e0 0x7f15280b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f152e6a6640 1 -- 172.21.15.87:0/1514889521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15280b0650 con 0x7f15280b1030 2024-05-09T07:54:48.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f152e6a6640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b1030 0x7f152812ff60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1520030000 tx=0x7f1520004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7fa66ffff640 1 -- 172.21.15.87:0/2577205483 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00b9e0 con 0x7fa68003b040 2024-05-09T07:54:48.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.324+0000 7f13a2d96640 1 -- 172.21.15.87:0/4085944354 shutdown_connections 2024-05-09T07:54:48.385 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f13a2d96640 1 -- 172.21.15.87:0/4085944354 wait complete. 2024-05-09T07:54:48.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7fa68c8c6640 1 -- 172.21.15.87:0/2577205483 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6800bed50 con 0x7fa68003b040 2024-05-09T07:54:48.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7fa68c8c6640 1 -- 172.21.15.87:0/2577205483 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6800c0850 con 0x7fa68003b040 2024-05-09T07:54:48.386 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f733009dd60 con 0x7f733014ca70 2024-05-09T07:54:48.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7fba117a2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba0c0add80 0x7fba0c0b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7fba117a2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba0c0b4770 0x7fba0c0b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7fba117a2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba0c14fa00 0x7fba0c130f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7ff800d25640 1 -- 172.21.15.87:0/1615311869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7fc141760 msgr2=0x7ff7fc141be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T07:54:48.387 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7ff800d25640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7fc141760 0x7ff7fc141be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7ff800d25640 1 -- 172.21.15.87:0/1615311869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7fc146420 msgr2=0x7ff7fc1468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7ff800d25640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7fc146420 0x7ff7fc1468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.388 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7ff800d25640 1 -- 172.21.15.87:0/1615311869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7fc146de0 con 0x7ff7ec003b70 2024-05-09T07:54:48.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7fba117a2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c0afb60 con 0x7fba0c14fa00 2024-05-09T07:54:48.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7fba117a2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c0af520 con 0x7fba0c0add80 2024-05-09T07:54:48.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7fba117a2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fba0c0afce0 con 0x7fba0c0b4770 2024-05-09T07:54:48.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba0c0b4770 0x7fba0c0b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba0c0add80 0x7fba0c0b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba0c0b4770 0x7fba0c0b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:47928/0 (socket says 172.21.15.87:47928) 2024-05-09T07:54:48.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0a7fc640 1 -- 172.21.15.87:0/3887810943 learned_addr learned my addr 172.21.15.87:0/3887810943 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0b7fe640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba0c14fa00 0x7fba0c130f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f13127fc640 1 -- 172.21.15.87:0/838446807 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1318041070 con 0x7f1314038880 2024-05-09T07:54:48.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.325+0000 7f13127fc640 1 -- 172.21.15.87:0/838446807 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318046660 con 0x7f1314038880 2024-05-09T07:54:48.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0a7fc640 1 -- 172.21.15.87:0/3887810943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba0c0add80 msgr2=0x7fba0c0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0a7fc640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba0c0add80 0x7fba0c0b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0a7fc640 1 -- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba0c14fa00 msgr2=0x7fba0c130f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.390 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0a7fc640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba0c14fa00 0x7fba0c130f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7f732cff9640 1 -- 172.21.15.87:0/1221029776 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7328039040 con 0x7f733014ca70 2024-05-09T07:54:48.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7fba0a7fc640 1 -- 172.21.15.87:0/3887810943 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c0b7bc0 con 0x7fba0c0b4770 2024-05-09T07:54:48.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.326+0000 7ff800d25640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec003b70 0x7ff7fc13c2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0005020 tx=0x7ff7f00048a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7f151e7fc640 1 -- 172.21.15.87:0/1514889521 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520041020 con 0x7f15280b1030 2024-05-09T07:54:48.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7f151e7fc640 1 -- 172.21.15.87:0/1514889521 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1520037040 con 0x7f15280b1030 2024-05-09T07:54:48.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7f151e7fc640 1 -- 172.21.15.87:0/1514889521 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1520036070 con 0x7f15280b1030 2024-05-09T07:54:48.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7fba0b7fe640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba0c14fa00 0x7fba0c130f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:48.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7fa66dffb640 1 -- 172.21.15.87:0/2577205483 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa660005290 con 0x7fa68003b040 2024-05-09T07:54:48.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7ff7f97fa640 1 -- 172.21.15.87:0/1615311869 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0001080 con 0x7ff7ec003b70 2024-05-09T07:54:48.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7fba0a7fc640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba0c0b4770 0x7fba0c0b6b60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba04009eb0 tx=0x7fba04004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1304005290 con 0x7f1314038880 2024-05-09T07:54:48.394 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7f13a2d96640 1 Processor -- start 2024-05-09T07:54:48.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7fb9f37fe640 1 -- 172.21.15.87:0/3887810943 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04040070 con 0x7fba0c0b4770 2024-05-09T07:54:48.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7fb9f37fe640 1 -- 172.21.15.87:0/3887810943 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba04031bc0 con 0x7fba0c0b4770 2024-05-09T07:54:48.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7fb9f37fe640 1 -- 172.21.15.87:0/3887810943 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0403c420 con 0x7fba0c0b4770 2024-05-09T07:54:48.395 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7f732cff9640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f731006be30 0x7f731006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7fc145bb0 con 0x7ff7ec003b70 2024-05-09T07:54:48.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.327+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7fc143fb0 con 0x7ff7ec003b70 2024-05-09T07:54:48.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.328+0000 7ff7f97fa640 1 -- 172.21.15.87:0/1615311869 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f0044070 con 0x7ff7ec003b70 2024-05-09T07:54:48.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.328+0000 7f1530109640 1 -- 172.21.15.87:0/1514889521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15280b25c0 con 0x7f15280b1030 2024-05-09T07:54:48.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.328+0000 7f1530109640 1 -- 172.21.15.87:0/1514889521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1528133a90 con 0x7f15280b1030 2024-05-09T07:54:48.396 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.328+0000 7f732cff9640 1 -- 172.21.15.87:0/1221029776 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f73280ac5d0 con 0x7f733014ca70 2024-05-09T07:54:48.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.328+0000 7f732f7fe640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f731006be30 0x7f731006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.328+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0c0b7e70 con 0x7fba0c0b4770 2024-05-09T07:54:48.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.328+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0c1370a0 con 0x7fba0c0b4770 2024-05-09T07:54:48.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.328+0000 7f13127fc640 1 -- 172.21.15.87:0/838446807 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1318046800 con 0x7f1314038880 2024-05-09T07:54:48.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.328+0000 7f732f7fe640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f731006be30 0x7f731006e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7320001590 tx=0x7f73200078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.329+0000 7f13127fc640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f130006be30 0x7f130006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.329+0000 7f13127fc640 1 -- 172.21.15.87:0/838446807 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f13180ab2d0 con 0x7f1314038880 2024-05-09T07:54:48.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.329+0000 7f1321411640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f130006be30 0x7f130006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.329+0000 7f13a2d96640 1 -- start start 2024-05-09T07:54:48.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.329+0000 7ff7f97fa640 1 -- 172.21.15.87:0/1615311869 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0005ab0 con 0x7ff7ec003b70 2024-05-09T07:54:48.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.330+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7dc005290 con 0x7ff7ec003b70 2024-05-09T07:54:48.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.330+0000 7f1321411640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f130006be30 0x7f130006e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13140ca6c0 tx=0x7f130c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.330+0000 7fa66ffff640 1 -- 172.21.15.87:0/2577205483 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa67c00bb80 con 0x7fa68003b040 2024-05-09T07:54:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.330+0000 7fa66ffff640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa67406bf00 0x7fa67406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.330+0000 7f13a2d96640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f139c06ca50 0x7f139c1431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.330+0000 7f13a2d96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0af170 0x7f139c13a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a2d96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0b6080 0x7f139c1e48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.400 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a0b32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f139c06ca50 0x7f139c1431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a0b32640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f139c06ca50 0x7f139c1431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55954/0 (socket says 172.21.15.87:55954) 2024-05-09T07:54:48.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.329+0000 7f150bfff640 1 -- 172.21.15.87:0/1514889521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1504005290 con 0x7f15280b1030 2024-05-09T07:54:48.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a0b32640 1 -- 172.21.15.87:0/1591429413 learned_addr learned my addr 172.21.15.87:0/1591429413 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ec005290 con 0x7fba0c0b4770 2024-05-09T07:54:48.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f139c09ee20 con 0x7f139c06ca50 2024-05-09T07:54:48.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.330+0000 7fa66ffff640 1 -- 172.21.15.87:0/2577205483 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa67c08b360 con 0x7fa68003b040 2024-05-09T07:54:48.402 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f139c0af5d0 con 0x7f139c0b6080 2024-05-09T07:54:48.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f139c147490 con 0x7f139c0af170 2024-05-09T07:54:48.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f139bfff640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0af170 0x7f139c13a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a1333640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0b6080 0x7f139c1e48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7fa686ffd640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa67406bf00 0x7fa67406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7ff7f97fa640 1 -- 172.21.15.87:0/1615311869 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7f00080e0 con 0x7ff7ec003b70 2024-05-09T07:54:48.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a0b32640 1 -- 172.21.15.87:0/1591429413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0af170 msgr2=0x7f139c13a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a0b32640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0af170 0x7f139c13a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a0b32640 1 -- 172.21.15.87:0/1591429413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0b6080 msgr2=0x7f139c1e48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a0b32640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0b6080 0x7f139c1e48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f13a0b32640 1 -- 172.21.15.87:0/1591429413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c1e1a20 con 0x7f139c06ca50 2024-05-09T07:54:48.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f151e7fc640 1 -- 172.21.15.87:0/1514889521 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1520044020 con 0x7f15280b1030 2024-05-09T07:54:48.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.331+0000 7f151e7fc640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f150c06bf00 0x7f150c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.332+0000 7f13a0b32640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f139c06ca50 0x7f139c1431f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1390000c00 tx=0x7f13900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.332+0000 7fa686ffd640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa67406bf00 0x7fa67406e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6800bd9b0 tx=0x7fa678009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.332+0000 7f151e7fc640 1 -- 172.21.15.87:0/1514889521 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f15200aba10 con 0x7f15280b1030 2024-05-09T07:54:48.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.332+0000 7f152dea5640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f150c06bf00 0x7f150c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.332+0000 7ff7f97fa640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff7e006c0a0 0x7ff7e006e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.332+0000 7ff7f97fa640 1 -- 172.21.15.87:0/1615311869 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff7f00ae820 con 0x7ff7ec003b70 2024-05-09T07:54:48.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.332+0000 7ff7fbfff640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff7e006c0a0 0x7ff7e006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.332+0000 7f152dea5640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f150c06bf00 0x7f150c06e3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1524009950 tx=0x7f1524008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.332+0000 7ff7fbfff640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff7e006c0a0 0x7ff7e006e560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc13d1e0 tx=0x7ff7e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.334+0000 7f732cff9640 1 -- 172.21.15.87:0/1221029776 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f733009dd60 con 0x7f733014ca70 2024-05-09T07:54:48.407 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.334+0000 7fa66ffff640 1 -- 172.21.15.87:0/2577205483 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa67c059730 con 0x7fa68003b040 2024-05-09T07:54:48.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.334+0000 7fb9f37fe640 1 -- 172.21.15.87:0/3887810943 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba04039040 con 0x7fba0c0b4770 2024-05-09T07:54:48.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.335+0000 7fb9f37fe640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb9f806be30 0x7fb9f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.335+0000 7fba0affd640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb9f806be30 0x7fb9f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.335+0000 7fba0affd640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb9f806be30 0x7fb9f806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0012b0 tx=0x7fb9fc007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.408 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.337+0000 7ff7f97fa640 1 -- 172.21.15.87:0/1615311869 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff7fc146de0 con 0x7ff7ec003b70 2024-05-09T07:54:48.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.339+0000 7f151e7fc640 1 -- 172.21.15.87:0/1514889521 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f152004b030 con 0x7f15280b1030 2024-05-09T07:54:48.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.339+0000 7fb9f37fe640 1 -- 172.21.15.87:0/3887810943 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fba04078540 con 0x7fba0c0b4770 2024-05-09T07:54:48.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.342+0000 7f13997fa640 1 -- 172.21.15.87:0/1591429413 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390043020 con 0x7f139c06ca50 2024-05-09T07:54:48.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.342+0000 7f13997fa640 1 -- 172.21.15.87:0/1591429413 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13900349b0 con 0x7f139c06ca50 2024-05-09T07:54:48.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.342+0000 7f13997fa640 1 -- 172.21.15.87:0/1591429413 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390038040 con 0x7f139c06ca50 2024-05-09T07:54:48.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.342+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c1e1d00 con 0x7f139c06ca50 2024-05-09T07:54:48.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.342+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c143730 con 0x7f139c06ca50 2024-05-09T07:54:48.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.342+0000 7f13127fc640 1 -- 172.21.15.87:0/838446807 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1318079be0 con 0x7f1314038880 2024-05-09T07:54:48.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.344+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f139c0756c0 con 0x7f139c06ca50 2024-05-09T07:54:48.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.346+0000 7fb9f37fe640 1 -- 172.21.15.87:0/3887810943 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fba0407a4a0 con 0x7fba0c0b4770 2024-05-09T07:54:48.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.346+0000 7f13997fa640 1 -- 172.21.15.87:0/1591429413 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1390046020 con 0x7f139c06ca50 2024-05-09T07:54:48.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.346+0000 7f13997fa640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f138806bf00 0x7f138806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.346+0000 7f13997fa640 1 -- 172.21.15.87:0/1591429413 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f13900ac720 con 0x7f139c06ca50 2024-05-09T07:54:48.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.349+0000 7f139bfff640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f138806bf00 0x7f138806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.350+0000 7f139bfff640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f138806bf00 0x7f138806e3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f139c1444b0 tx=0x7f138c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.354+0000 7f13997fa640 1 -- 172.21.15.87:0/1591429413 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f139004d070 con 0x7f139c06ca50 2024-05-09T07:54:48.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.699+0000 7fe7757fa640 1 -- 172.21.15.87:0/731976539 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe7900b3020 con 0x7fe79008a570 2024-05-09T07:54:48.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.700+0000 7fe7777fe640 1 -- 172.21.15.87:0/731976539 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe7880592f0 con 0x7fe79008a570 2024-05-09T07:54:48.714 INFO:teuthology.orchestra.run.smithi087.stdout:60129542152 2024-05-09T07:54:48.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.703+0000 7fe79488b640 1 -- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe77c06be60 msgr2=0x7fe77c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.703+0000 7fe79488b640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe77c06be60 0x7fe77c06e320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe784006fd0 tx=0x7fe784008040 comp rx=0 tx=0).stop 2024-05-09T07:54:48.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.703+0000 7fe79488b640 1 -- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe79008a570 msgr2=0x7fe79008aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.703+0000 7fe79488b640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe79008a570 0x7fe79008aa20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe7900b2a40 tx=0x7fe78800e490 comp rx=0 tx=0).stop 2024-05-09T07:54:48.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.705+0000 7fe79488b640 1 -- 172.21.15.87:0/731976539 shutdown_connections 2024-05-09T07:54:48.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.705+0000 7fe79488b640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe77c06be60 0x7fe77c06e320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.705+0000 7fe79488b640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79009d750 0x7fe7901e9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.705+0000 7fe79488b640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe79008a570 0x7fe79008aa20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.705+0000 7fe79488b640 1 --2- 172.21.15.87:0/731976539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79009acb0 0x7fe7901e9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.705+0000 7fe79488b640 1 -- 172.21.15.87:0/731976539 >> 172.21.15.87:0/731976539 conn(0x7fe7900b5650 msgr2=0x7fe7900b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.705+0000 7fe79488b640 1 -- 172.21.15.87:0/731976539 shutdown_connections 2024-05-09T07:54:48.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.705+0000 7fe79488b640 1 -- 172.21.15.87:0/731976539 wait complete. 2024-05-09T07:54:48.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2024-05-09T07:54:48.737 DEBUG:teuthology.parallel:result is None 2024-05-09T07:54:48.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.734+0000 7fa66dffb640 1 -- 172.21.15.87:0/2577205483 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa660005850 con 0x7fa68003b040 2024-05-09T07:54:48.749 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.735+0000 7fa66ffff640 1 -- 172.21.15.87:0/2577205483 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa67c05da30 con 0x7fa68003b040 2024-05-09T07:54:48.749 INFO:teuthology.orchestra.run.smithi087.stdout:55834574854 2024-05-09T07:54:48.750 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.736+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f73300b78e0 con 0x7f733014ca70 2024-05-09T07:54:48.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.736+0000 7f732cff9640 1 -- 172.21.15.87:0/1221029776 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f73300b78e0 con 0x7f733014ca70 2024-05-09T07:54:48.751 INFO:teuthology.orchestra.run.smithi087.stdout:60129542152 2024-05-09T07:54:48.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 -- 172.21.15.87:0/2577205483 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa67406bf00 msgr2=0x7fa67406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa67406bf00 0x7fa67406e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6800bd9b0 tx=0x7fa678009040 comp rx=0 tx=0).stop 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 -- 172.21.15.87:0/2577205483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa68003b040 msgr2=0x7fa6800c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa68003b040 0x7fa6800c9520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00d620 tx=0x7fa67c00dae0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 -- 172.21.15.87:0/2577205483 shutdown_connections 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa67406bf00 0x7fa67406e3c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa6800c6270 0x7fa6800bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa68003c800 0x7fa680165820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 --2- 172.21.15.87:0/2577205483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa68003b040 0x7fa6800c9520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.737+0000 7fa66dffb640 1 -- 172.21.15.87:0/2577205483 >> 172.21.15.87:0/2577205483 conn(0x7fa68003ed20 msgr2=0x7fa68003cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.738+0000 7fa66dffb640 1 -- 172.21.15.87:0/2577205483 shutdown_connections 2024-05-09T07:54:48.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.738+0000 7fa66dffb640 1 -- 172.21.15.87:0/2577205483 wait complete. 2024-05-09T07:54:48.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.739+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f731006be30 msgr2=0x7f731006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.739+0000 7f733624d640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f731006be30 0x7f731006e2f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7320001590 tx=0x7f73200078f0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f733014ca70 msgr2=0x7f73300712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f733014ca70 0x7f73300712b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f732802abe0 tx=0x7f7328004a40 comp rx=0 tx=0).stop 2024-05-09T07:54:48.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 shutdown_connections 2024-05-09T07:54:48.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f731006be30 0x7f731006e2f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7330146360 0x7f7330070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f733014ca70 0x7f73300712b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 --2- 172.21.15.87:0/1221029776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73300b3f20 0x7f733009d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 >> 172.21.15.87:0/1221029776 conn(0x7f73300b6020 msgr2=0x7f7330156fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 shutdown_connections 2024-05-09T07:54:48.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.740+0000 7f733624d640 1 -- 172.21.15.87:0/1221029776 wait complete. 2024-05-09T07:54:48.761 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.747+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff7dc005580 con 0x7ff7ec003b70 2024-05-09T07:54:48.762 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.747+0000 7ff7f97fa640 1 -- 172.21.15.87:0/1615311869 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff7f0047360 con 0x7ff7ec003b70 2024-05-09T07:54:48.762 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-05-09T07:54:48.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-05-09T07:54:48.766 DEBUG:teuthology.parallel:result is None 2024-05-09T07:54:48.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.750+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff7e006c0a0 msgr2=0x7ff7e006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.766 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.750+0000 7ff802f89640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff7e006c0a0 0x7ff7e006e560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc13d1e0 tx=0x7ff7e8008040 comp rx=0 tx=0).stop 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec003b70 msgr2=0x7ff7fc13c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec003b70 0x7ff7fc13c2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0005020 tx=0x7ff7f00048a0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 shutdown_connections 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff7e006c0a0 0x7ff7e006e560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7fc141760 0x7ff7fc141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7fc146420 0x7ff7fc1468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 --2- 172.21.15.87:0/1615311869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7ec003b70 0x7ff7fc13c2a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 >> 172.21.15.87:0/1615311869 conn(0x7ff7fc0b96f0 msgr2=0x7ff7fc06c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 shutdown_connections 2024-05-09T07:54:48.767 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.751+0000 7ff802f89640 1 -- 172.21.15.87:0/1615311869 wait complete. 2024-05-09T07:54:48.768 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.754+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1304005580 con 0x7f1314038880 2024-05-09T07:54:48.769 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.754+0000 7f13127fc640 1 -- 172.21.15.87:0/838446807 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13180ab0d0 con 0x7f1314038880 2024-05-09T07:54:48.769 INFO:teuthology.orchestra.run.smithi087.stdout:55834574856 2024-05-09T07:54:48.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.1 2024-05-09T07:54:48.773 DEBUG:teuthology.parallel:result is None 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f130006be30 msgr2=0x7f130006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f130006be30 0x7f130006e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f13140ca6c0 tx=0x7f130c008040 comp rx=0 tx=0).stop 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1314038880 msgr2=0x7f13140c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1314038880 0x7f13140c8db0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13180098c0 tx=0x7f13180046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 shutdown_connections 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f130006be30 0x7f130006e2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13140cc780 0x7f13140c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13140ccbc0 0x7f13140cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 --2- 172.21.15.87:0/838446807 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1314038880 0x7f13140c8db0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 >> 172.21.15.87:0/838446807 conn(0x7f131403ea70 msgr2=0x7f131403ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.774 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 shutdown_connections 2024-05-09T07:54:48.775 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.758+0000 7f1322c14640 1 -- 172.21.15.87:0/838446807 wait complete. 2024-05-09T07:54:48.776 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.762+0000 7f150bfff640 1 -- 172.21.15.87:0/1514889521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1504005580 con 0x7f15280b1030 2024-05-09T07:54:48.777 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.763+0000 7f151e7fc640 1 -- 172.21.15.87:0/1514889521 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f152007a3a0 con 0x7f15280b1030 2024-05-09T07:54:48.777 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-05-09T07:54:48.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.764+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f139c1e1ed0 con 0x7f139c06ca50 2024-05-09T07:54:48.779 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f13997fa640 1 -- 172.21.15.87:0/1591429413 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13900473b0 con 0x7f139c06ca50 2024-05-09T07:54:48.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 -- 172.21.15.87:0/1514889521 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f150c06bf00 msgr2=0x7f150c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f150c06bf00 0x7f150c06e3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1524009950 tx=0x7f1524008040 comp rx=0 tx=0).stop 2024-05-09T07:54:48.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 -- 172.21.15.87:0/1514889521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b1030 msgr2=0x7f152812ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.780 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b1030 0x7f152812ff60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1520030000 tx=0x7f1520004a40 comp rx=0 tx=0).stop 2024-05-09T07:54:48.780 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-05-09T07:54:48.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 -- 172.21.15.87:0/1514889521 shutdown_connections 2024-05-09T07:54:48.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f150c06bf00 0x7f150c06e3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15280b1030 0x7f152812ff60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.781 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15280b5420 0x7f15280b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 --2- 172.21.15.87:0/1514889521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f15280b44e0 0x7f15280b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 -- 172.21.15.87:0/1514889521 >> 172.21.15.87:0/1514889521 conn(0x7f15280bd0e0 msgr2=0x7f152814b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 -- 172.21.15.87:0/1514889521 shutdown_connections 2024-05-09T07:54:48.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.765+0000 7f150bfff640 1 -- 172.21.15.87:0/1514889521 wait complete. 2024-05-09T07:54:48.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.766+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb9ec005850 con 0x7fba0c0b4770 2024-05-09T07:54:48.782 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.766+0000 7fb9f37fe640 1 -- 172.21.15.87:0/3887810943 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba0407e7a0 con 0x7fba0c0b4770 2024-05-09T07:54:48.783 INFO:teuthology.orchestra.run.smithi087.stdout:55834574855 2024-05-09T07:54:48.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-05-09T07:54:48.784 DEBUG:teuthology.parallel:result is None 2024-05-09T07:54:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f138806bf00 msgr2=0x7f138806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f138806bf00 0x7f138806e3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f139c1444b0 tx=0x7f138c009040 comp rx=0 tx=0).stop 2024-05-09T07:54:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f139c06ca50 msgr2=0x7f139c1431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f139c06ca50 0x7f139c1431f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1390000c00 tx=0x7f13900046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 shutdown_connections 2024-05-09T07:54:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f138806bf00 0x7f138806e3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.785 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0af170 0x7f139c13a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0b6080 0x7f139c1e48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 --2- 172.21.15.87:0/1591429413 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f139c06ca50 0x7f139c1431f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 >> 172.21.15.87:0/1591429413 conn(0x7f139c0b5590 msgr2=0x7f139c0b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 shutdown_connections 2024-05-09T07:54:48.786 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.768+0000 7f13a2d96640 1 -- 172.21.15.87:0/1591429413 wait complete. 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb9f806be30 msgr2=0x7fb9f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb9f806be30 0x7fb9f806e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0012b0 tx=0x7fb9fc007b70 comp rx=0 tx=0).stop 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba0c0b4770 msgr2=0x7fba0c0b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba0c0b4770 0x7fba0c0b6b60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fba04009eb0 tx=0x7fba04004a40 comp rx=0 tx=0).stop 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 shutdown_connections 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb9f806be30 0x7fb9f806e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba0c0b4770 0x7fba0c0b6b60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fba0c14fa00 0x7fba0c130f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 --2- 172.21.15.87:0/3887810943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba0c0add80 0x7fba0c0b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 >> 172.21.15.87:0/3887810943 conn(0x7fba0c0b5860 msgr2=0x7fba0c074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.787 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 shutdown_connections 2024-05-09T07:54:48.788 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.769+0000 7fba117a2640 1 -- 172.21.15.87:0/3887810943 wait complete. 2024-05-09T07:54:48.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-05-09T07:54:48.789 DEBUG:teuthology.parallel:result is None 2024-05-09T07:54:48.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-05-09T07:54:48.794 DEBUG:teuthology.parallel:result is None 2024-05-09T07:54:48.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-05-09T07:54:48.797 DEBUG:teuthology.parallel:result is None 2024-05-09T07:54:48.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-05-09T07:54:48.797 DEBUG:teuthology.parallel:result is None 2024-05-09T07:54:48.797 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T07:54:48.798 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T07:54:48.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.922+0000 7fd5e514f640 1 Processor -- start 2024-05-09T07:54:48.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.922+0000 7fd5e514f640 1 -- start start 2024-05-09T07:54:48.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5e514f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e00b3e30 0x7fd5e0141580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5e514f640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e0147e30 con 0x7fd5e0141ac0 2024-05-09T07:54:48.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5e514f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e00b5900 con 0x7fd5e00b5e20 2024-05-09T07:54:48.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5e514f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e00b50c0 con 0x7fd5e00b3e30 2024-05-09T07:54:48.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5df59e640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd5e0141ac0 0x7fd5e0152080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43714/0 (socket says 172.21.15.87:43714) 2024-05-09T07:54:48.941 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5df59e640 1 -- 172.21.15.87:0/1339444209 learned_addr learned my addr 172.21.15.87:0/1339444209 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5de59c640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e00b3e30 0x7fd5e0141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388903951 0 0) 0x7fd5e0147e30 con 0x7fd5e0141ac0 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c8003520 con 0x7fd5e0141ac0 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317608779 0 0) 0x7fd5e00b5900 con 0x7fd5e00b5e20 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5e0147e30 con 0x7fd5e00b5e20 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2530231287 0 0) 0x7fd5c8003520 con 0x7fd5e0141ac0 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e00b3e30 msgr2=0x7fd5e0141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5ddd9b640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e00b3e30 0x7fd5e0141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 >> v1:172.21.15.110:6789/0 conn(0x7fd5e00b5e20 legacy=0x7fd5e0147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.923+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e00b4a70 con 0x7fd5e0141ac0 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7fd5d8001670 con 0x7fd5e0141ac0 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 >> v1:172.21.15.87:6789/0 conn(0x7fd5e0141ac0 legacy=0x7fd5e0152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.942 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5ddd9b640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c8003b70 0x7fd5c8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5ddd9b640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c8004800 0x7fd5c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5ddd9b640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e00b3e30 0x7fd5c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e00b50c0 con 0x7fd5c8004800 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c800ba70 con 0x7fd5c8003b70 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c800bc40 con 0x7fd5e00b3e30 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5de59c640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c8004800 0x7fd5c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5ded9d640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c8003b70 0x7fd5c8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5df59e640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e00b3e30 0x7fd5c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5de59c640 1 -- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e00b3e30 msgr2=0x7fd5c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5de59c640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e00b3e30 0x7fd5c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5de59c640 1 -- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c8003b70 msgr2=0x7fd5c8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5de59c640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c8003b70 0x7fd5c8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5de59c640 1 -- 172.21.15.87:0/1339444209 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c8003520 con 0x7fd5c8004800 2024-05-09T07:54:48.943 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.924+0000 7fd5df59e640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e00b3e30 0x7fd5c80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5de59c640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c8004800 0x7fd5c8004c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009ac0 tx=0x7fd5c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c298edf682216d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4036070 con 0x7fd5c8004800 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d4031400 con 0x7fd5c8004800 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5ddd9b640 1 -- 172.21.15.87:0/1339444209 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4009690 con 0x7fd5c8004800 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5e514f640 1 -- 172.21.15.87:0/1339444209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c8004800 msgr2=0x7fd5c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5e514f640 1 --2- 172.21.15.87:0/1339444209 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5c8004800 0x7fd5c8004c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009ac0 tx=0x7fd5c8005830 comp rx=0 tx=0).stop 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5df59e640 1 -- 172.21.15.87:0/1339444209 reap_dead start 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5e514f640 1 -- 172.21.15.87:0/1339444209 shutdown_connections 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5e514f640 1 -- 172.21.15.87:0/1339444209 >> 172.21.15.87:0/1339444209 conn(0x7fd5e00676a0 msgr2=0x7fd5e00bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5e514f640 1 -- 172.21.15.87:0/1339444209 shutdown_connections 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.925+0000 7fd5e514f640 1 -- 172.21.15.87:0/1339444209 wait complete. 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5e514f640 1 Processor -- start 2024-05-09T07:54:48.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5e514f640 1 -- start start 2024-05-09T07:54:48.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5e514f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c8004800 0x7fd5e01cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5e514f640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e01cdf40 0x7fd5e0144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5e514f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e01e0130 0x7fd5e01e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5e514f640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e00b5550 con 0x7fd5e01cdf40 2024-05-09T07:54:48.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5e514f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e00b6200 con 0x7fd5c8004800 2024-05-09T07:54:48.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5e514f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e01ce7d0 con 0x7fd5e01e0130 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5de59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e01cdf40 0x7fd5e0144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5de59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e01cdf40 0x7fd5e0144910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55986/0 (socket says 172.21.15.87:55986) 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.927+0000 7fd5de59c640 1 -- 172.21.15.87:0/3371730781 learned_addr learned my addr 172.21.15.87:0/3371730781 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5de59c640 1 -- 172.21.15.87:0/3371730781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e01e0130 msgr2=0x7fd5e01e05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5de59c640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e01e0130 0x7fd5e01e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5de59c640 1 -- 172.21.15.87:0/3371730781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c8004800 msgr2=0x7fd5e01cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5ded9d640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c8004800 0x7fd5e01cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5de59c640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c8004800 0x7fd5e01cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5de59c640 1 -- 172.21.15.87:0/3371730781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e01cd980 con 0x7fd5e01cdf40 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5de59c640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e01cdf40 0x7fd5e0144910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009be0 tx=0x7fd5d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5c77fe640 1 -- 172.21.15.87:0/3371730781 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4041020 con 0x7fd5e01cdf40 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5c77fe640 1 -- 172.21.15.87:0/3371730781 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d403c470 con 0x7fd5e01cdf40 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5c77fe640 1 -- 172.21.15.87:0/3371730781 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4036040 con 0x7fd5e01cdf40 2024-05-09T07:54:48.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e01cf500 con 0x7fd5e01cdf40 2024-05-09T07:54:48.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.928+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e01443f0 con 0x7fd5e01cdf40 2024-05-09T07:54:48.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.929+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e00691f0 con 0x7fd5e01cdf40 2024-05-09T07:54:48.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.930+0000 7fd5c77fe640 1 -- 172.21.15.87:0/3371730781 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5d4044020 con 0x7fd5e01cdf40 2024-05-09T07:54:48.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.930+0000 7fd5c77fe640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd5cc06be30 0x7fd5cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:48.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.930+0000 7fd5c77fe640 1 -- 172.21.15.87:0/3371730781 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5d40ab520 con 0x7fd5e01cdf40 2024-05-09T07:54:48.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.930+0000 7fd5ded9d640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd5cc06be30 0x7fd5cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:48.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.930+0000 7fd5ded9d640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd5cc06be30 0x7fd5cc06e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0003ec0 tx=0x7fd5d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:48.949 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:48.934+0000 7fd5c77fe640 1 -- 172.21.15.87:0/3371730781 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fd5d404b030 con 0x7fd5e01cdf40 2024-05-09T07:54:49.122 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.107+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5e01cf210 con 0x7fd5cc06be30 2024-05-09T07:54:49.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.113+0000 7fd5c77fe640 1 -- 172.21.15.87:0/3371730781 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7fd5e01cf210 con 0x7fd5cc06be30 2024-05-09T07:54:49.130 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:49.132 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T07:54:49.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd5cc06be30 msgr2=0x7fd5cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd5cc06be30 0x7fd5cc06e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0003ec0 tx=0x7fd5d0009040 comp rx=0 tx=0).stop 2024-05-09T07:54:49.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e01cdf40 msgr2=0x7fd5e0144910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e01cdf40 0x7fd5e0144910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4009be0 tx=0x7fd5d4004730 comp rx=0 tx=0).stop 2024-05-09T07:54:49.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 shutdown_connections 2024-05-09T07:54:49.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd5cc06be30 0x7fd5cc06e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5e01e0130 0x7fd5e01e05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5e01cdf40 0x7fd5e0144910 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.134 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 --2- 172.21.15.87:0/3371730781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c8004800 0x7fd5e01cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 >> 172.21.15.87:0/3371730781 conn(0x7fd5e00676a0 msgr2=0x7fd5e0146f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:49.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 shutdown_connections 2024-05-09T07:54:49.135 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.116+0000 7fd5e514f640 1 -- 172.21.15.87:0/3371730781 wait complete. 2024-05-09T07:54:49.142 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-05-09T07:54:48.894039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235696,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739024,"statfs":{"total":773094113280,"available":772852760576,"internally_reserved":0,"allocated":2957312,"data_stored":1785916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.806585"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126816+0000","last_change":"2024-05-09T07:54:37.107065+0000","last_active":"2024-05-09T07:54:38.126816+0000","last_peered":"2024-05-09T07:54:38.126816+0000","last_clean":"2024-05-09T07:54:38.126816+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T07:54:38.126816+0000","last_undegraded":"2024-05-09T07:54:38.126816+0000","last_fullsized":"2024-05-09T07:54:38.126816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089122+0000","last_change":"2024-05-09T07:54:37.109460+0000","last_active":"2024-05-09T07:54:38.089122+0000","last_peered":"2024-05-09T07:54:38.089122+0000","last_clean":"2024-05-09T07:54:38.089122+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T07:54:38.089122+0000","last_undegraded":"2024-05-09T07:54:38.089122+0000","last_fullsized":"2024-05-09T07:54:38.089122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114255+0000","last_change":"2024-05-09T07:54:37.108923+0000","last_active":"2024-05-09T07:54:38.114255+0000","last_peered":"2024-05-09T07:54:38.114255+0000","last_clean":"2024-05-09T07:54:38.114255+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T07:54:38.114255+0000","last_undegraded":"2024-05-09T07:54:38.114255+0000","last_fullsized":"2024-05-09T07:54:38.114255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090307+0000","last_change":"2024-05-09T07:54:37.104600+0000","last_active":"2024-05-09T07:54:38.090307+0000","last_peered":"2024-05-09T07:54:38.090307+0000","last_clean":"2024-05-09T07:54:38.090307+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T07:54:38.090307+0000","last_undegraded":"2024-05-09T07:54:38.090307+0000","last_fullsized":"2024-05-09T07:54:38.090307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126911+0000","last_change":"2024-05-09T07:54:37.104101+0000","last_active":"2024-05-09T07:54:38.126911+0000","last_peered":"2024-05-09T07:54:38.126911+0000","last_clean":"2024-05-09T07:54:38.126911+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T07:54:38.126911+0000","last_undegraded":"2024-05-09T07:54:38.126911+0000","last_fullsized":"2024-05-09T07:54:38.126911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089353+0000","last_change":"2024-05-09T07:54:37.109462+0000","last_active":"2024-05-09T07:54:38.089353+0000","last_peered":"2024-05-09T07:54:38.089353+0000","last_clean":"2024-05-09T07:54:38.089353+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T07:54:38.089353+0000","last_undegraded":"2024-05-09T07:54:38.089353+0000","last_fullsized":"2024-05-09T07:54:38.089353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126521+0000","last_change":"2024-05-09T07:54:37.114222+0000","last_active":"2024-05-09T07:54:38.126521+0000","last_peered":"2024-05-09T07:54:38.126521+0000","last_clean":"2024-05-09T07:54:38.126521+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T07:54:38.126521+0000","last_undegraded":"2024-05-09T07:54:38.126521+0000","last_fullsized":"2024-05-09T07:54:38.126521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125744+0000","last_change":"2024-05-09T07:54:37.110852+0000","last_active":"2024-05-09T07:54:38.125744+0000","last_peered":"2024-05-09T07:54:38.125744+0000","last_clean":"2024-05-09T07:54:38.125744+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T07:54:38.125744+0000","last_undegraded":"2024-05-09T07:54:38.125744+0000","last_fullsized":"2024-05-09T07:54:38.125744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126973+0000","last_change":"2024-05-09T07:54:37.106997+0000","last_active":"2024-05-09T07:54:38.126973+0000","last_peered":"2024-05-09T07:54:38.126973+0000","last_clean":"2024-05-09T07:54:38.126973+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T07:54:38.126973+0000","last_undegraded":"2024-05-09T07:54:38.126973+0000","last_fullsized":"2024-05-09T07:54:38.126973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090143+0000","last_change":"2024-05-09T07:54:37.112111+0000","last_active":"2024-05-09T07:54:38.090143+0000","last_peered":"2024-05-09T07:54:38.090143+0000","last_clean":"2024-05-09T07:54:38.090143+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T07:54:38.090143+0000","last_undegraded":"2024-05-09T07:54:38.090143+0000","last_fullsized":"2024-05-09T07:54:38.090143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089595+0000","last_change":"2024-05-09T07:54:37.111412+0000","last_active":"2024-05-09T07:54:38.089595+0000","last_peered":"2024-05-09T07:54:38.089595+0000","last_clean":"2024-05-09T07:54:38.089595+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T07:54:38.089595+0000","last_undegraded":"2024-05-09T07:54:38.089595+0000","last_fullsized":"2024-05-09T07:54:38.089595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126529+0000","last_change":"2024-05-09T07:54:37.103229+0000","last_active":"2024-05-09T07:54:38.126529+0000","last_peered":"2024-05-09T07:54:38.126529+0000","last_clean":"2024-05-09T07:54:38.126529+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T07:54:38.126529+0000","last_undegraded":"2024-05-09T07:54:38.126529+0000","last_fullsized":"2024-05-09T07:54:38.126529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125825+0000","last_change":"2024-05-09T07:54:37.104238+0000","last_active":"2024-05-09T07:54:38.125825+0000","last_peered":"2024-05-09T07:54:38.125825+0000","last_clean":"2024-05-09T07:54:38.125825+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T07:54:38.125825+0000","last_undegraded":"2024-05-09T07:54:38.125825+0000","last_fullsized":"2024-05-09T07:54:38.125825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114110+0000","last_change":"2024-05-09T07:54:37.105958+0000","last_active":"2024-05-09T07:54:38.114110+0000","last_peered":"2024-05-09T07:54:38.114110+0000","last_clean":"2024-05-09T07:54:38.114110+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T07:54:38.114110+0000","last_undegraded":"2024-05-09T07:54:38.114110+0000","last_fullsized":"2024-05-09T07:54:38.114110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:38.316625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089163+0000","last_change":"2024-05-09T07:54:37.090690+0000","last_active":"2024-05-09T07:54:38.089163+0000","last_peered":"2024-05-09T07:54:38.089163+0000","last_clean":"2024-05-09T07:54:38.089163+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T07:54:38.089163+0000","last_undegraded":"2024-05-09T07:54:38.089163+0000","last_fullsized":"2024-05-09T07:54:38.089163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088954+0000","last_change":"2024-05-09T07:54:37.110834+0000","last_active":"2024-05-09T07:54:38.088954+0000","last_peered":"2024-05-09T07:54:38.088954+0000","last_clean":"2024-05-09T07:54:38.088954+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T07:54:38.088954+0000","last_undegraded":"2024-05-09T07:54:38.088954+0000","last_fullsized":"2024-05-09T07:54:38.088954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090130+0000","last_change":"2024-05-09T07:54:37.099545+0000","last_active":"2024-05-09T07:54:38.090130+0000","last_peered":"2024-05-09T07:54:38.090130+0000","last_clean":"2024-05-09T07:54:38.090130+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T07:54:38.090130+0000","last_undegraded":"2024-05-09T07:54:38.090130+0000","last_fullsized":"2024-05-09T07:54:38.090130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:37.105054+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127307+0000","last_change":"2024-05-09T07:54:37.104090+0000","last_active":"2024-05-09T07:54:38.127307+0000","last_peered":"2024-05-09T07:54:38.127307+0000","last_clean":"2024-05-09T07:54:38.127307+0000","last_became_active":"2024-05-09T07:54:37.103793+0000","last_became_peered":"2024-05-09T07:54:37.103793+0000","last_unstale":"2024-05-09T07:54:38.127307+0000","last_undegraded":"2024-05-09T07:54:38.127307+0000","last_fullsized":"2024-05-09T07:54:38.127307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089303+0000","last_change":"2024-05-09T07:54:37.110846+0000","last_active":"2024-05-09T07:54:38.089303+0000","last_peered":"2024-05-09T07:54:38.089303+0000","last_clean":"2024-05-09T07:54:38.089303+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T07:54:38.089303+0000","last_undegraded":"2024-05-09T07:54:38.089303+0000","last_fullsized":"2024-05-09T07:54:38.089303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114306+0000","last_change":"2024-05-09T07:54:37.110392+0000","last_active":"2024-05-09T07:54:38.114306+0000","last_peered":"2024-05-09T07:54:38.114306+0000","last_clean":"2024-05-09T07:54:38.114306+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T07:54:38.114306+0000","last_undegraded":"2024-05-09T07:54:38.114306+0000","last_fullsized":"2024-05-09T07:54:38.114306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090055+0000","last_change":"2024-05-09T07:54:37.098797+0000","last_active":"2024-05-09T07:54:38.090055+0000","last_peered":"2024-05-09T07:54:38.090055+0000","last_clean":"2024-05-09T07:54:38.090055+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T07:54:38.090055+0000","last_undegraded":"2024-05-09T07:54:38.090055+0000","last_fullsized":"2024-05-09T07:54:38.090055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125904+0000","last_change":"2024-05-09T07:54:37.112262+0000","last_active":"2024-05-09T07:54:38.125904+0000","last_peered":"2024-05-09T07:54:38.125904+0000","last_clean":"2024-05-09T07:54:38.125904+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T07:54:38.125904+0000","last_undegraded":"2024-05-09T07:54:38.125904+0000","last_fullsized":"2024-05-09T07:54:38.125904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090032+0000","last_change":"2024-05-09T07:54:37.102723+0000","last_active":"2024-05-09T07:54:38.090032+0000","last_peered":"2024-05-09T07:54:38.090032+0000","last_clean":"2024-05-09T07:54:38.090032+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T07:54:38.090032+0000","last_undegraded":"2024-05-09T07:54:38.090032+0000","last_fullsized":"2024-05-09T07:54:38.090032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126375+0000","last_change":"2024-05-09T07:54:37.101021+0000","last_active":"2024-05-09T07:54:38.126375+0000","last_peered":"2024-05-09T07:54:38.126375+0000","last_clean":"2024-05-09T07:54:38.126375+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T07:54:38.126375+0000","last_undegraded":"2024-05-09T07:54:38.126375+0000","last_fullsized":"2024-05-09T07:54:38.126375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090192+0000","last_change":"2024-05-09T07:54:37.106515+0000","last_active":"2024-05-09T07:54:38.090192+0000","last_peered":"2024-05-09T07:54:38.090192+0000","last_clean":"2024-05-09T07:54:38.090192+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T07:54:38.090192+0000","last_undegraded":"2024-05-09T07:54:38.090192+0000","last_fullsized":"2024-05-09T07:54:38.090192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089051+0000","last_change":"2024-05-09T07:54:37.101475+0000","last_active":"2024-05-09T07:54:38.089051+0000","last_peered":"2024-05-09T07:54:38.089051+0000","last_clean":"2024-05-09T07:54:38.089051+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T07:54:38.089051+0000","last_undegraded":"2024-05-09T07:54:38.089051+0000","last_fullsized":"2024-05-09T07:54:38.089051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126288+0000","last_change":"2024-05-09T07:54:37.112908+0000","last_active":"2024-05-09T07:54:38.126288+0000","last_peered":"2024-05-09T07:54:38.126288+0000","last_clean":"2024-05-09T07:54:38.126288+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T07:54:38.126288+0000","last_undegraded":"2024-05-09T07:54:38.126288+0000","last_fullsized":"2024-05-09T07:54:38.126288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114353+0000","last_change":"2024-05-09T07:54:37.109141+0000","last_active":"2024-05-09T07:54:38.114353+0000","last_peered":"2024-05-09T07:54:38.114353+0000","last_clean":"2024-05-09T07:54:38.114353+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T07:54:38.114353+0000","last_undegraded":"2024-05-09T07:54:38.114353+0000","last_fullsized":"2024-05-09T07:54:38.114353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089775+0000","last_change":"2024-05-09T07:54:37.103105+0000","last_active":"2024-05-09T07:54:38.089775+0000","last_peered":"2024-05-09T07:54:38.089775+0000","last_clean":"2024-05-09T07:54:38.089775+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T07:54:38.089775+0000","last_undegraded":"2024-05-09T07:54:38.089775+0000","last_fullsized":"2024-05-09T07:54:38.089775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125972+0000","last_change":"2024-05-09T07:54:37.109657+0000","last_active":"2024-05-09T07:54:38.125972+0000","last_peered":"2024-05-09T07:54:38.125972+0000","last_clean":"2024-05-09T07:54:38.125972+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T07:54:38.125972+0000","last_undegraded":"2024-05-09T07:54:38.125972+0000","last_fullsized":"2024-05-09T07:54:38.125972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089035+0000","last_change":"2024-05-09T07:54:37.111278+0000","last_active":"2024-05-09T07:54:38.089035+0000","last_peered":"2024-05-09T07:54:38.089035+0000","last_clean":"2024-05-09T07:54:38.089035+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T07:54:38.089035+0000","last_undegraded":"2024-05-09T07:54:38.089035+0000","last_fullsized":"2024-05-09T07:54:38.089035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126302+0000","last_change":"2024-05-09T07:54:37.099560+0000","last_active":"2024-05-09T07:54:38.126302+0000","last_peered":"2024-05-09T07:54:38.126302+0000","last_clean":"2024-05-09T07:54:38.126302+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T07:54:38.126302+0000","last_undegraded":"2024-05-09T07:54:38.126302+0000","last_fullsized":"2024-05-09T07:54:38.126302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:30.636185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126183+0000","last_change":"2024-05-09T07:54:36.105511+0000","last_active":"2024-05-09T07:54:38.126183+0000","last_peered":"2024-05-09T07:54:38.126183+0000","last_clean":"2024-05-09T07:54:38.126183+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T07:54:38.126183+0000","last_undegraded":"2024-05-09T07:54:38.126183+0000","last_fullsized":"2024-05-09T07:54:38.126183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114445+0000","last_change":"2024-05-09T07:54:37.110626+0000","last_active":"2024-05-09T07:54:38.114445+0000","last_peered":"2024-05-09T07:54:38.114445+0000","last_clean":"2024-05-09T07:54:38.114445+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T07:54:38.114445+0000","last_undegraded":"2024-05-09T07:54:38.114445+0000","last_fullsized":"2024-05-09T07:54:38.114445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089405+0000","last_change":"2024-05-09T07:54:36.099522+0000","last_active":"2024-05-09T07:54:38.089405+0000","last_peered":"2024-05-09T07:54:38.089405+0000","last_clean":"2024-05-09T07:54:38.089405+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T07:54:38.089405+0000","last_undegraded":"2024-05-09T07:54:38.089405+0000","last_fullsized":"2024-05-09T07:54:38.089405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126052+0000","last_change":"2024-05-09T07:54:36.103352+0000","last_active":"2024-05-09T07:54:38.126052+0000","last_peered":"2024-05-09T07:54:38.126052+0000","last_clean":"2024-05-09T07:54:38.126052+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T07:54:38.126052+0000","last_undegraded":"2024-05-09T07:54:38.126052+0000","last_fullsized":"2024-05-09T07:54:38.126052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125742+0000","last_change":"2024-05-09T07:54:37.113565+0000","last_active":"2024-05-09T07:54:38.125742+0000","last_peered":"2024-05-09T07:54:38.125742+0000","last_clean":"2024-05-09T07:54:38.125742+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T07:54:38.125742+0000","last_undegraded":"2024-05-09T07:54:38.125742+0000","last_fullsized":"2024-05-09T07:54:38.125742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089786+0000","last_change":"2024-05-09T07:54:36.091893+0000","last_active":"2024-05-09T07:54:38.089786+0000","last_peered":"2024-05-09T07:54:38.089786+0000","last_clean":"2024-05-09T07:54:38.089786+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T07:54:38.089786+0000","last_undegraded":"2024-05-09T07:54:38.089786+0000","last_fullsized":"2024-05-09T07:54:38.089786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088976+0000","last_change":"2024-05-09T07:54:37.106284+0000","last_active":"2024-05-09T07:54:38.088976+0000","last_peered":"2024-05-09T07:54:38.088976+0000","last_clean":"2024-05-09T07:54:38.088976+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T07:54:38.088976+0000","last_undegraded":"2024-05-09T07:54:38.088976+0000","last_fullsized":"2024-05-09T07:54:38.088976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089802+0000","last_change":"2024-05-09T07:54:36.100068+0000","last_active":"2024-05-09T07:54:38.089802+0000","last_peered":"2024-05-09T07:54:38.089802+0000","last_clean":"2024-05-09T07:54:38.089802+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T07:54:38.089802+0000","last_undegraded":"2024-05-09T07:54:38.089802+0000","last_fullsized":"2024-05-09T07:54:38.089802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089637+0000","last_change":"2024-05-09T07:54:37.099653+0000","last_active":"2024-05-09T07:54:38.089637+0000","last_peered":"2024-05-09T07:54:38.089637+0000","last_clean":"2024-05-09T07:54:38.089637+0000","last_became_active":"2024-05-09T07:54:37.099256+0000","last_became_peered":"2024-05-09T07:54:37.099256+0000","last_unstale":"2024-05-09T07:54:38.089637+0000","last_undegraded":"2024-05-09T07:54:38.089637+0000","last_fullsized":"2024-05-09T07:54:38.089637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090072+0000","last_change":"2024-05-09T07:54:36.100368+0000","last_active":"2024-05-09T07:54:38.090072+0000","last_peered":"2024-05-09T07:54:38.090072+0000","last_clean":"2024-05-09T07:54:38.090072+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T07:54:38.090072+0000","last_undegraded":"2024-05-09T07:54:38.090072+0000","last_fullsized":"2024-05-09T07:54:38.090072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114311+0000","last_change":"2024-05-09T07:54:37.107847+0000","last_active":"2024-05-09T07:54:38.114311+0000","last_peered":"2024-05-09T07:54:38.114311+0000","last_clean":"2024-05-09T07:54:38.114311+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T07:54:38.114311+0000","last_undegraded":"2024-05-09T07:54:38.114311+0000","last_fullsized":"2024-05-09T07:54:38.114311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089184+0000","last_change":"2024-05-09T07:54:36.101694+0000","last_active":"2024-05-09T07:54:38.089184+0000","last_peered":"2024-05-09T07:54:38.089184+0000","last_clean":"2024-05-09T07:54:38.089184+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T07:54:38.089184+0000","last_undegraded":"2024-05-09T07:54:38.089184+0000","last_fullsized":"2024-05-09T07:54:38.089184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126626+0000","last_change":"2024-05-09T07:54:37.098733+0000","last_active":"2024-05-09T07:54:38.126626+0000","last_peered":"2024-05-09T07:54:38.126626+0000","last_clean":"2024-05-09T07:54:38.126626+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T07:54:38.126626+0000","last_undegraded":"2024-05-09T07:54:38.126626+0000","last_fullsized":"2024-05-09T07:54:38.126626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:15.571989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089966+0000","last_change":"2024-05-09T07:54:36.103096+0000","last_active":"2024-05-09T07:54:38.089966+0000","last_peered":"2024-05-09T07:54:38.089966+0000","last_clean":"2024-05-09T07:54:38.089966+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T07:54:38.089966+0000","last_undegraded":"2024-05-09T07:54:38.089966+0000","last_fullsized":"2024-05-09T07:54:38.089966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127096+0000","last_change":"2024-05-09T07:54:37.101875+0000","last_active":"2024-05-09T07:54:38.127096+0000","last_peered":"2024-05-09T07:54:38.127096+0000","last_clean":"2024-05-09T07:54:38.127096+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T07:54:38.127096+0000","last_undegraded":"2024-05-09T07:54:38.127096+0000","last_fullsized":"2024-05-09T07:54:38.127096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114462+0000","last_change":"2024-05-09T07:54:36.090977+0000","last_active":"2024-05-09T07:54:38.114462+0000","last_peered":"2024-05-09T07:54:38.114462+0000","last_clean":"2024-05-09T07:54:38.114462+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T07:54:38.114462+0000","last_undegraded":"2024-05-09T07:54:38.114462+0000","last_fullsized":"2024-05-09T07:54:38.114462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:17.768144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114204+0000","last_change":"2024-05-09T07:54:37.105813+0000","last_active":"2024-05-09T07:54:38.114204+0000","last_peered":"2024-05-09T07:54:38.114204+0000","last_clean":"2024-05-09T07:54:38.114204+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T07:54:38.114204+0000","last_undegraded":"2024-05-09T07:54:38.114204+0000","last_fullsized":"2024-05-09T07:54:38.114204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:02.185354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089886+0000","last_change":"2024-05-09T07:54:36.102510+0000","last_active":"2024-05-09T07:54:38.089886+0000","last_peered":"2024-05-09T07:54:38.089886+0000","last_clean":"2024-05-09T07:54:38.089886+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T07:54:38.089886+0000","last_undegraded":"2024-05-09T07:54:38.089886+0000","last_fullsized":"2024-05-09T07:54:38.089886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126997+0000","last_change":"2024-05-09T07:54:37.105015+0000","last_active":"2024-05-09T07:54:38.126997+0000","last_peered":"2024-05-09T07:54:38.126997+0000","last_clean":"2024-05-09T07:54:38.126997+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T07:54:38.126997+0000","last_undegraded":"2024-05-09T07:54:38.126997+0000","last_fullsized":"2024-05-09T07:54:38.126997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089058+0000","last_change":"2024-05-09T07:54:36.103721+0000","last_active":"2024-05-09T07:54:38.089058+0000","last_peered":"2024-05-09T07:54:38.089058+0000","last_clean":"2024-05-09T07:54:38.089058+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T07:54:38.089058+0000","last_undegraded":"2024-05-09T07:54:38.089058+0000","last_fullsized":"2024-05-09T07:54:38.089058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088980+0000","last_change":"2024-05-09T07:54:37.111215+0000","last_active":"2024-05-09T07:54:38.088980+0000","last_peered":"2024-05-09T07:54:38.088980+0000","last_clean":"2024-05-09T07:54:38.088980+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T07:54:38.088980+0000","last_undegraded":"2024-05-09T07:54:38.088980+0000","last_fullsized":"2024-05-09T07:54:38.088980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125695+0000","last_change":"2024-05-09T07:54:36.098598+0000","last_active":"2024-05-09T07:54:38.125695+0000","last_peered":"2024-05-09T07:54:38.125695+0000","last_clean":"2024-05-09T07:54:38.125695+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T07:54:38.125695+0000","last_undegraded":"2024-05-09T07:54:38.125695+0000","last_fullsized":"2024-05-09T07:54:38.125695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126550+0000","last_change":"2024-05-09T07:54:37.102764+0000","last_active":"2024-05-09T07:54:38.126550+0000","last_peered":"2024-05-09T07:54:38.126550+0000","last_clean":"2024-05-09T07:54:38.126550+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T07:54:38.126550+0000","last_undegraded":"2024-05-09T07:54:38.126550+0000","last_fullsized":"2024-05-09T07:54:38.126550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126466+0000","last_change":"2024-05-09T07:54:36.092365+0000","last_active":"2024-05-09T07:54:38.126466+0000","last_peered":"2024-05-09T07:54:38.126466+0000","last_clean":"2024-05-09T07:54:38.126466+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T07:54:38.126466+0000","last_undegraded":"2024-05-09T07:54:38.126466+0000","last_fullsized":"2024-05-09T07:54:38.126466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127009+0000","last_change":"2024-05-09T07:54:37.100214+0000","last_active":"2024-05-09T07:54:38.127009+0000","last_peered":"2024-05-09T07:54:38.127009+0000","last_clean":"2024-05-09T07:54:38.127009+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T07:54:38.127009+0000","last_undegraded":"2024-05-09T07:54:38.127009+0000","last_fullsized":"2024-05-09T07:54:38.127009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126065+0000","last_change":"2024-05-09T07:54:36.100004+0000","last_active":"2024-05-09T07:54:38.126065+0000","last_peered":"2024-05-09T07:54:38.126065+0000","last_clean":"2024-05-09T07:54:38.126065+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T07:54:38.126065+0000","last_undegraded":"2024-05-09T07:54:38.126065+0000","last_fullsized":"2024-05-09T07:54:38.126065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127108+0000","last_change":"2024-05-09T07:54:37.100879+0000","last_active":"2024-05-09T07:54:38.127108+0000","last_peered":"2024-05-09T07:54:38.127108+0000","last_clean":"2024-05-09T07:54:38.127108+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T07:54:38.127108+0000","last_undegraded":"2024-05-09T07:54:38.127108+0000","last_fullsized":"2024-05-09T07:54:38.127108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089145+0000","last_change":"2024-05-09T07:54:36.099594+0000","last_active":"2024-05-09T07:54:38.089145+0000","last_peered":"2024-05-09T07:54:38.089145+0000","last_clean":"2024-05-09T07:54:38.089145+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T07:54:38.089145+0000","last_undegraded":"2024-05-09T07:54:38.089145+0000","last_fullsized":"2024-05-09T07:54:38.089145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090354+0000","last_change":"2024-05-09T07:54:37.103885+0000","last_active":"2024-05-09T07:54:38.090354+0000","last_peered":"2024-05-09T07:54:38.090354+0000","last_clean":"2024-05-09T07:54:38.090354+0000","last_became_active":"2024-05-09T07:54:37.103150+0000","last_became_peered":"2024-05-09T07:54:37.103150+0000","last_unstale":"2024-05-09T07:54:38.090354+0000","last_undegraded":"2024-05-09T07:54:38.090354+0000","last_fullsized":"2024-05-09T07:54:38.090354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125835+0000","last_change":"2024-05-09T07:54:36.097398+0000","last_active":"2024-05-09T07:54:38.125835+0000","last_peered":"2024-05-09T07:54:38.125835+0000","last_clean":"2024-05-09T07:54:38.125835+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T07:54:38.125835+0000","last_undegraded":"2024-05-09T07:54:38.125835+0000","last_fullsized":"2024-05-09T07:54:38.125835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127276+0000","last_change":"2024-05-09T07:54:37.108574+0000","last_active":"2024-05-09T07:54:38.127276+0000","last_peered":"2024-05-09T07:54:38.127276+0000","last_clean":"2024-05-09T07:54:38.127276+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T07:54:38.127276+0000","last_undegraded":"2024-05-09T07:54:38.127276+0000","last_fullsized":"2024-05-09T07:54:38.127276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089307+0000","last_change":"2024-05-09T07:54:36.097635+0000","last_active":"2024-05-09T07:54:38.089307+0000","last_peered":"2024-05-09T07:54:38.089307+0000","last_clean":"2024-05-09T07:54:38.089307+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T07:54:38.089307+0000","last_undegraded":"2024-05-09T07:54:38.089307+0000","last_fullsized":"2024-05-09T07:54:38.089307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125983+0000","last_change":"2024-05-09T07:54:37.111470+0000","last_active":"2024-05-09T07:54:38.125983+0000","last_peered":"2024-05-09T07:54:38.125983+0000","last_clean":"2024-05-09T07:54:38.125983+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T07:54:38.125983+0000","last_undegraded":"2024-05-09T07:54:38.125983+0000","last_fullsized":"2024-05-09T07:54:38.125983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126209+0000","last_change":"2024-05-09T07:54:36.107162+0000","last_active":"2024-05-09T07:54:38.126209+0000","last_peered":"2024-05-09T07:54:38.126209+0000","last_clean":"2024-05-09T07:54:38.126209+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T07:54:38.126209+0000","last_undegraded":"2024-05-09T07:54:38.126209+0000","last_fullsized":"2024-05-09T07:54:38.126209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114106+0000","last_change":"2024-05-09T07:54:37.102062+0000","last_active":"2024-05-09T07:54:38.114106+0000","last_peered":"2024-05-09T07:54:38.114106+0000","last_clean":"2024-05-09T07:54:38.114106+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T07:54:38.114106+0000","last_undegraded":"2024-05-09T07:54:38.114106+0000","last_fullsized":"2024-05-09T07:54:38.114106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:32.555846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125875+0000","last_change":"2024-05-09T07:54:36.100227+0000","last_active":"2024-05-09T07:54:38.125875+0000","last_peered":"2024-05-09T07:54:38.125875+0000","last_clean":"2024-05-09T07:54:38.125875+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T07:54:38.125875+0000","last_undegraded":"2024-05-09T07:54:38.125875+0000","last_fullsized":"2024-05-09T07:54:38.125875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089178+0000","last_change":"2024-05-09T07:54:37.109167+0000","last_active":"2024-05-09T07:54:38.089178+0000","last_peered":"2024-05-09T07:54:38.089178+0000","last_clean":"2024-05-09T07:54:38.089178+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T07:54:38.089178+0000","last_undegraded":"2024-05-09T07:54:38.089178+0000","last_fullsized":"2024-05-09T07:54:38.089178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090002+0000","last_change":"2024-05-09T07:54:36.100426+0000","last_active":"2024-05-09T07:54:38.090002+0000","last_peered":"2024-05-09T07:54:38.090002+0000","last_clean":"2024-05-09T07:54:38.090002+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T07:54:38.090002+0000","last_undegraded":"2024-05-09T07:54:38.090002+0000","last_fullsized":"2024-05-09T07:54:38.090002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126610+0000","last_change":"2024-05-09T07:54:37.108794+0000","last_active":"2024-05-09T07:54:38.126610+0000","last_peered":"2024-05-09T07:54:38.126610+0000","last_clean":"2024-05-09T07:54:38.126610+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T07:54:38.126610+0000","last_undegraded":"2024-05-09T07:54:38.126610+0000","last_fullsized":"2024-05-09T07:54:38.126610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:43.498827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089162+0000","last_change":"2024-05-09T07:54:36.104155+0000","last_active":"2024-05-09T07:54:38.089162+0000","last_peered":"2024-05-09T07:54:38.089162+0000","last_clean":"2024-05-09T07:54:38.089162+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T07:54:38.089162+0000","last_undegraded":"2024-05-09T07:54:38.089162+0000","last_fullsized":"2024-05-09T07:54:38.089162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090218+0000","last_change":"2024-05-09T07:54:37.103562+0000","last_active":"2024-05-09T07:54:38.090218+0000","last_peered":"2024-05-09T07:54:38.090218+0000","last_clean":"2024-05-09T07:54:38.090218+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T07:54:38.090218+0000","last_undegraded":"2024-05-09T07:54:38.090218+0000","last_fullsized":"2024-05-09T07:54:38.090218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127376+0000","last_change":"2024-05-09T07:54:36.106399+0000","last_active":"2024-05-09T07:54:38.127376+0000","last_peered":"2024-05-09T07:54:38.127376+0000","last_clean":"2024-05-09T07:54:38.127376+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T07:54:38.127376+0000","last_undegraded":"2024-05-09T07:54:38.127376+0000","last_fullsized":"2024-05-09T07:54:38.127376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089072+0000","last_change":"2024-05-09T07:54:37.105988+0000","last_active":"2024-05-09T07:54:38.089072+0000","last_peered":"2024-05-09T07:54:38.089072+0000","last_clean":"2024-05-09T07:54:38.089072+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T07:54:38.089072+0000","last_undegraded":"2024-05-09T07:54:38.089072+0000","last_fullsized":"2024-05-09T07:54:38.089072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.102035+0000","last_change":"2024-05-09T07:54:36.101002+0000","last_active":"2024-05-09T07:54:38.102035+0000","last_peered":"2024-05-09T07:54:38.102035+0000","last_clean":"2024-05-09T07:54:38.102035+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T07:54:38.102035+0000","last_undegraded":"2024-05-09T07:54:38.102035+0000","last_fullsized":"2024-05-09T07:54:38.102035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126405+0000","last_change":"2024-05-09T07:54:37.100183+0000","last_active":"2024-05-09T07:54:38.126405+0000","last_peered":"2024-05-09T07:54:38.126405+0000","last_clean":"2024-05-09T07:54:38.126405+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T07:54:38.126405+0000","last_undegraded":"2024-05-09T07:54:38.126405+0000","last_fullsized":"2024-05-09T07:54:38.126405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089901+0000","last_change":"2024-05-09T07:54:36.105813+0000","last_active":"2024-05-09T07:54:38.089901+0000","last_peered":"2024-05-09T07:54:38.089901+0000","last_clean":"2024-05-09T07:54:38.089901+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T07:54:38.089901+0000","last_undegraded":"2024-05-09T07:54:38.089901+0000","last_fullsized":"2024-05-09T07:54:38.089901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114359+0000","last_change":"2024-05-09T07:54:37.107782+0000","last_active":"2024-05-09T07:54:38.114359+0000","last_peered":"2024-05-09T07:54:38.114359+0000","last_clean":"2024-05-09T07:54:38.114359+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T07:54:38.114359+0000","last_undegraded":"2024-05-09T07:54:38.114359+0000","last_fullsized":"2024-05-09T07:54:38.114359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125962+0000","last_change":"2024-05-09T07:54:36.106409+0000","last_active":"2024-05-09T07:54:38.125962+0000","last_peered":"2024-05-09T07:54:38.125962+0000","last_clean":"2024-05-09T07:54:38.125962+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T07:54:38.125962+0000","last_undegraded":"2024-05-09T07:54:38.125962+0000","last_fullsized":"2024-05-09T07:54:38.125962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126537+0000","last_change":"2024-05-09T07:54:37.104920+0000","last_active":"2024-05-09T07:54:38.126537+0000","last_peered":"2024-05-09T07:54:38.126537+0000","last_clean":"2024-05-09T07:54:38.126537+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T07:54:38.126537+0000","last_undegraded":"2024-05-09T07:54:38.126537+0000","last_fullsized":"2024-05-09T07:54:38.126537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089089+0000","last_change":"2024-05-09T07:54:36.105662+0000","last_active":"2024-05-09T07:54:38.089089+0000","last_peered":"2024-05-09T07:54:38.089089+0000","last_clean":"2024-05-09T07:54:38.089089+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T07:54:38.089089+0000","last_undegraded":"2024-05-09T07:54:38.089089+0000","last_fullsized":"2024-05-09T07:54:38.089089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125906+0000","last_change":"2024-05-09T07:54:37.103640+0000","last_active":"2024-05-09T07:54:38.125906+0000","last_peered":"2024-05-09T07:54:38.125906+0000","last_clean":"2024-05-09T07:54:38.125906+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T07:54:38.125906+0000","last_undegraded":"2024-05-09T07:54:38.125906+0000","last_fullsized":"2024-05-09T07:54:38.125906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089139+0000","last_change":"2024-05-09T07:54:36.102636+0000","last_active":"2024-05-09T07:54:38.089139+0000","last_peered":"2024-05-09T07:54:38.089139+0000","last_clean":"2024-05-09T07:54:38.089139+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T07:54:38.089139+0000","last_undegraded":"2024-05-09T07:54:38.089139+0000","last_fullsized":"2024-05-09T07:54:38.089139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126076+0000","last_change":"2024-05-09T07:54:37.113734+0000","last_active":"2024-05-09T07:54:38.126076+0000","last_peered":"2024-05-09T07:54:38.126076+0000","last_clean":"2024-05-09T07:54:38.126076+0000","last_became_active":"2024-05-09T07:54:37.113448+0000","last_became_peered":"2024-05-09T07:54:37.113448+0000","last_unstale":"2024-05-09T07:54:38.126076+0000","last_undegraded":"2024-05-09T07:54:38.126076+0000","last_fullsized":"2024-05-09T07:54:38.126076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127166+0000","last_change":"2024-05-09T07:54:36.104367+0000","last_active":"2024-05-09T07:54:38.127166+0000","last_peered":"2024-05-09T07:54:38.127166+0000","last_clean":"2024-05-09T07:54:38.127166+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T07:54:38.127166+0000","last_undegraded":"2024-05-09T07:54:38.127166+0000","last_fullsized":"2024-05-09T07:54:38.127166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088985+0000","last_change":"2024-05-09T07:54:37.111038+0000","last_active":"2024-05-09T07:54:38.088985+0000","last_peered":"2024-05-09T07:54:38.088985+0000","last_clean":"2024-05-09T07:54:38.088985+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T07:54:38.088985+0000","last_undegraded":"2024-05-09T07:54:38.088985+0000","last_fullsized":"2024-05-09T07:54:38.088985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089727+0000","last_change":"2024-05-09T07:54:37.091699+0000","last_active":"2024-05-09T07:54:38.089727+0000","last_peered":"2024-05-09T07:54:38.089727+0000","last_clean":"2024-05-09T07:54:38.089727+0000","last_became_active":"2024-05-09T07:54:37.091280+0000","last_became_peered":"2024-05-09T07:54:37.091280+0000","last_unstale":"2024-05-09T07:54:38.089727+0000","last_undegraded":"2024-05-09T07:54:38.089727+0000","last_fullsized":"2024-05-09T07:54:38.089727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127058+0000","last_change":"2024-05-09T07:54:36.105726+0000","last_active":"2024-05-09T07:54:38.127058+0000","last_peered":"2024-05-09T07:54:38.127058+0000","last_clean":"2024-05-09T07:54:38.127058+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T07:54:38.127058+0000","last_undegraded":"2024-05-09T07:54:38.127058+0000","last_fullsized":"2024-05-09T07:54:38.127058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090261+0000","last_change":"2024-05-09T07:54:37.092061+0000","last_active":"2024-05-09T07:54:38.090261+0000","last_peered":"2024-05-09T07:54:38.090261+0000","last_clean":"2024-05-09T07:54:38.090261+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T07:54:38.090261+0000","last_undegraded":"2024-05-09T07:54:38.090261+0000","last_fullsized":"2024-05-09T07:54:38.090261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127214+0000","last_change":"2024-05-09T07:54:36.106635+0000","last_active":"2024-05-09T07:54:38.127214+0000","last_peered":"2024-05-09T07:54:38.127214+0000","last_clean":"2024-05-09T07:54:38.127214+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T07:54:38.127214+0000","last_undegraded":"2024-05-09T07:54:38.127214+0000","last_fullsized":"2024-05-09T07:54:38.127214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114272+0000","last_change":"2024-05-09T07:54:37.108470+0000","last_active":"2024-05-09T07:54:38.114272+0000","last_peered":"2024-05-09T07:54:38.114272+0000","last_clean":"2024-05-09T07:54:38.114272+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T07:54:38.114272+0000","last_undegraded":"2024-05-09T07:54:38.114272+0000","last_fullsized":"2024-05-09T07:54:38.114272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126415+0000","last_change":"2024-05-09T07:54:36.102502+0000","last_active":"2024-05-09T07:54:38.126415+0000","last_peered":"2024-05-09T07:54:38.126415+0000","last_clean":"2024-05-09T07:54:38.126415+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T07:54:38.126415+0000","last_undegraded":"2024-05-09T07:54:38.126415+0000","last_fullsized":"2024-05-09T07:54:38.126415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126360+0000","last_change":"2024-05-09T07:54:37.104598+0000","last_active":"2024-05-09T07:54:38.126360+0000","last_peered":"2024-05-09T07:54:38.126360+0000","last_clean":"2024-05-09T07:54:38.126360+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T07:54:38.126360+0000","last_undegraded":"2024-05-09T07:54:38.126360+0000","last_fullsized":"2024-05-09T07:54:38.126360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114410+0000","last_change":"2024-05-09T07:54:36.101744+0000","last_active":"2024-05-09T07:54:38.114410+0000","last_peered":"2024-05-09T07:54:38.114410+0000","last_clean":"2024-05-09T07:54:38.114410+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T07:54:38.114410+0000","last_undegraded":"2024-05-09T07:54:38.114410+0000","last_fullsized":"2024-05-09T07:54:38.114410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":665995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":76657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T07:54:49.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T07:54:49.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.268+0000 7f5d75cbd640 1 Processor -- start 2024-05-09T07:54:49.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.268+0000 7f5d75cbd640 1 -- start start 2024-05-09T07:54:49.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d75cbd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5d700af900 0x7f5d700b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d75cbd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d700af1b0 0x7f5d700b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d75cbd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700b4210 0x7f5d700b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d75cbd640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5d700b3d80 con 0x7f5d700af900 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d75cbd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5d700b0ed0 con 0x7f5d700af1b0 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d75cbd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700b3770 con 0x7f5d700b4210 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5d700af900 0x7f5d700b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5d700af900 0x7f5d700b28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:55988/0 (socket says 172.21.15.87:55988) 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6f7fe640 1 -- 172.21.15.87:0/1303920075 learned_addr learned my addr 172.21.15.87:0/1303920075 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6ffff640 1 --2- 172.21.15.87:0/1303920075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700b4210 0x7f5d700b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6effd640 1 --2- 172.21.15.87:0/1303920075 >> v2:172.21.15.110:3300/0 conn(0x7f5d700af1b0 0x7f5d700b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6f7fe640 1 -- 172.21.15.87:0/1303920075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700b4210 msgr2=0x7f5d700b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6f7fe640 1 --2- 172.21.15.87:0/1303920075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700b4210 0x7f5d700b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6f7fe640 1 -- 172.21.15.87:0/1303920075 >> v2:172.21.15.110:3300/0 conn(0x7f5d700af1b0 msgr2=0x7f5d700b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6f7fe640 1 --2- 172.21.15.87:0/1303920075 >> v2:172.21.15.110:3300/0 conn(0x7f5d700af1b0 0x7f5d700b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.269+0000 7f5d6f7fe640 1 -- 172.21.15.87:0/1303920075 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d700b5530 con 0x7f5d700af900 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.270+0000 7f5d6f7fe640 1 --2- 172.21.15.87:0/1303920075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700af900 0x7f5d700b28e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5d700b04e0 tx=0x7f5d6002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb8052777d826cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:49.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.270+0000 7f5d6e7fc640 1 -- 172.21.15.87:0/1303920075 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60036070 con 0x7f5d700af900 2024-05-09T07:54:49.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.270+0000 7f5d6e7fc640 1 -- 172.21.15.87:0/1303920075 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d60031600 con 0x7f5d700af900 2024-05-09T07:54:49.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.270+0000 7f5d6e7fc640 1 -- 172.21.15.87:0/1303920075 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d600319d0 con 0x7f5d700af900 2024-05-09T07:54:49.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.271+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1303920075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700af900 msgr2=0x7f5d700b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.271+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1303920075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700af900 0x7f5d700b28e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5d700b04e0 tx=0x7f5d6002a570 comp rx=0 tx=0).stop 2024-05-09T07:54:49.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.271+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1303920075 shutdown_connections 2024-05-09T07:54:49.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.271+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1303920075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700b4210 0x7f5d700b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.289 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.271+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1303920075 >> v2:172.21.15.110:3300/0 conn(0x7f5d700af1b0 0x7f5d700b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.271+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1303920075 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700af900 0x7f5d700b28e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.271+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1303920075 >> 172.21.15.87:0/1303920075 conn(0x7f5d7006c6a0 msgr2=0x7f5d7006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:49.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.271+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1303920075 shutdown_connections 2024-05-09T07:54:49.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.271+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1303920075 wait complete. 2024-05-09T07:54:49.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.272+0000 7f5d75cbd640 1 Processor -- start 2024-05-09T07:54:49.290 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.272+0000 7f5d75cbd640 1 -- start start 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.272+0000 7f5d75cbd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700af1b0 0x7f5d70142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d75cbd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700af900 0x7f5d70141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d75cbd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700b4210 0x7f5d701de010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d75cbd640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700afce0 con 0x7f5d700b4210 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d75cbd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700b4b70 con 0x7f5d700af900 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d75cbd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700ade30 con 0x7f5d700af1b0 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700b4210 0x7f5d701de010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700b4210 0x7f5d701de010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56000/0 (socket says 172.21.15.87:56000) 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6ffff640 1 -- 172.21.15.87:0/1880629274 learned_addr learned my addr 172.21.15.87:0/1880629274 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6f7fe640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700af1b0 0x7f5d70142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6effd640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700af900 0x7f5d70141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.293 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6ffff640 1 -- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700af1b0 msgr2=0x7f5d70142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6ffff640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700af1b0 0x7f5d70142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6ffff640 1 -- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700af900 msgr2=0x7f5d70141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6ffff640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700af900 0x7f5d70141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6ffff640 1 -- 172.21.15.87:0/1880629274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d70144650 con 0x7f5d700b4210 2024-05-09T07:54:49.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6effd640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700af900 0x7f5d70141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:49.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6f7fe640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700af1b0 0x7f5d70142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:49.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d6ffff640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700b4210 0x7f5d701de010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800d5d0 tx=0x7f5d6800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:49.294 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d57fff640 1 -- 172.21.15.87:0/1880629274 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d680125f0 con 0x7f5d700b4210 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d57fff640 1 -- 172.21.15.87:0/1880629274 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d68019070 con 0x7f5d700b4210 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d70141c90 con 0x7f5d700b4210 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d57fff640 1 -- 172.21.15.87:0/1880629274 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d680129f0 con 0x7f5d700b4210 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.273+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7013cc50 con 0x7f5d700b4210 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.274+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d70072b50 con 0x7f5d700b4210 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.275+0000 7f5d57fff640 1 -- 172.21.15.87:0/1880629274 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d68012b90 con 0x7f5d700b4210 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.275+0000 7f5d57fff640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5d5c06be30 0x7f5d5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.275+0000 7f5d57fff640 1 -- 172.21.15.87:0/1880629274 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5d6808b1a0 con 0x7f5d700b4210 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.275+0000 7f5d6f7fe640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5d5c06be30 0x7f5d5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.275+0000 7f5d6f7fe640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5d5c06be30 0x7f5d5c06e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5d60033000 tx=0x7f5d60009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:49.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.279+0000 7f5d57fff640 1 -- 172.21.15.87:0/1880629274 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5d70072b50 con 0x7f5d700b4210 2024-05-09T07:54:49.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.450+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d700691f0 con 0x7f5d5c06be30 2024-05-09T07:54:49.470 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.456+0000 7f5d57fff640 1 -- 172.21.15.87:0/1880629274 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f5d700691f0 con 0x7f5d5c06be30 2024-05-09T07:54:49.473 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:49.476 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5d5c06be30 msgr2=0x7f5d5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5d5c06be30 0x7f5d5c06e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5d60033000 tx=0x7f5d60009000 comp rx=0 tx=0).stop 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700b4210 msgr2=0x7f5d701de010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700b4210 0x7f5d701de010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800d5d0 tx=0x7f5d6800da90 comp rx=0 tx=0).stop 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 shutdown_connections 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5d5c06be30 0x7f5d5c06e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d700b4210 0x7f5d701de010 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d700af900 0x7f5d70141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 --2- 172.21.15.87:0/1880629274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d700af1b0 0x7f5d70142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 >> 172.21.15.87:0/1880629274 conn(0x7f5d7006c6a0 msgr2=0x7f5d700b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:49.480 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 shutdown_connections 2024-05-09T07:54:49.481 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.459+0000 7f5d75cbd640 1 -- 172.21.15.87:0/1880629274 wait complete. 2024-05-09T07:54:49.484 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-05-09T07:54:48.894039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235696,"kb_used_data":2888,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739024,"statfs":{"total":773094113280,"available":772852760576,"internally_reserved":0,"allocated":2957312,"data_stored":1785916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.806585"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126816+0000","last_change":"2024-05-09T07:54:37.107065+0000","last_active":"2024-05-09T07:54:38.126816+0000","last_peered":"2024-05-09T07:54:38.126816+0000","last_clean":"2024-05-09T07:54:38.126816+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T07:54:38.126816+0000","last_undegraded":"2024-05-09T07:54:38.126816+0000","last_fullsized":"2024-05-09T07:54:38.126816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089122+0000","last_change":"2024-05-09T07:54:37.109460+0000","last_active":"2024-05-09T07:54:38.089122+0000","last_peered":"2024-05-09T07:54:38.089122+0000","last_clean":"2024-05-09T07:54:38.089122+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T07:54:38.089122+0000","last_undegraded":"2024-05-09T07:54:38.089122+0000","last_fullsized":"2024-05-09T07:54:38.089122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114255+0000","last_change":"2024-05-09T07:54:37.108923+0000","last_active":"2024-05-09T07:54:38.114255+0000","last_peered":"2024-05-09T07:54:38.114255+0000","last_clean":"2024-05-09T07:54:38.114255+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T07:54:38.114255+0000","last_undegraded":"2024-05-09T07:54:38.114255+0000","last_fullsized":"2024-05-09T07:54:38.114255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090307+0000","last_change":"2024-05-09T07:54:37.104600+0000","last_active":"2024-05-09T07:54:38.090307+0000","last_peered":"2024-05-09T07:54:38.090307+0000","last_clean":"2024-05-09T07:54:38.090307+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T07:54:38.090307+0000","last_undegraded":"2024-05-09T07:54:38.090307+0000","last_fullsized":"2024-05-09T07:54:38.090307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126911+0000","last_change":"2024-05-09T07:54:37.104101+0000","last_active":"2024-05-09T07:54:38.126911+0000","last_peered":"2024-05-09T07:54:38.126911+0000","last_clean":"2024-05-09T07:54:38.126911+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T07:54:38.126911+0000","last_undegraded":"2024-05-09T07:54:38.126911+0000","last_fullsized":"2024-05-09T07:54:38.126911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089353+0000","last_change":"2024-05-09T07:54:37.109462+0000","last_active":"2024-05-09T07:54:38.089353+0000","last_peered":"2024-05-09T07:54:38.089353+0000","last_clean":"2024-05-09T07:54:38.089353+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T07:54:38.089353+0000","last_undegraded":"2024-05-09T07:54:38.089353+0000","last_fullsized":"2024-05-09T07:54:38.089353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126521+0000","last_change":"2024-05-09T07:54:37.114222+0000","last_active":"2024-05-09T07:54:38.126521+0000","last_peered":"2024-05-09T07:54:38.126521+0000","last_clean":"2024-05-09T07:54:38.126521+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T07:54:38.126521+0000","last_undegraded":"2024-05-09T07:54:38.126521+0000","last_fullsized":"2024-05-09T07:54:38.126521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125744+0000","last_change":"2024-05-09T07:54:37.110852+0000","last_active":"2024-05-09T07:54:38.125744+0000","last_peered":"2024-05-09T07:54:38.125744+0000","last_clean":"2024-05-09T07:54:38.125744+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T07:54:38.125744+0000","last_undegraded":"2024-05-09T07:54:38.125744+0000","last_fullsized":"2024-05-09T07:54:38.125744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126973+0000","last_change":"2024-05-09T07:54:37.106997+0000","last_active":"2024-05-09T07:54:38.126973+0000","last_peered":"2024-05-09T07:54:38.126973+0000","last_clean":"2024-05-09T07:54:38.126973+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T07:54:38.126973+0000","last_undegraded":"2024-05-09T07:54:38.126973+0000","last_fullsized":"2024-05-09T07:54:38.126973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090143+0000","last_change":"2024-05-09T07:54:37.112111+0000","last_active":"2024-05-09T07:54:38.090143+0000","last_peered":"2024-05-09T07:54:38.090143+0000","last_clean":"2024-05-09T07:54:38.090143+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T07:54:38.090143+0000","last_undegraded":"2024-05-09T07:54:38.090143+0000","last_fullsized":"2024-05-09T07:54:38.090143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089595+0000","last_change":"2024-05-09T07:54:37.111412+0000","last_active":"2024-05-09T07:54:38.089595+0000","last_peered":"2024-05-09T07:54:38.089595+0000","last_clean":"2024-05-09T07:54:38.089595+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T07:54:38.089595+0000","last_undegraded":"2024-05-09T07:54:38.089595+0000","last_fullsized":"2024-05-09T07:54:38.089595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126529+0000","last_change":"2024-05-09T07:54:37.103229+0000","last_active":"2024-05-09T07:54:38.126529+0000","last_peered":"2024-05-09T07:54:38.126529+0000","last_clean":"2024-05-09T07:54:38.126529+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T07:54:38.126529+0000","last_undegraded":"2024-05-09T07:54:38.126529+0000","last_fullsized":"2024-05-09T07:54:38.126529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125825+0000","last_change":"2024-05-09T07:54:37.104238+0000","last_active":"2024-05-09T07:54:38.125825+0000","last_peered":"2024-05-09T07:54:38.125825+0000","last_clean":"2024-05-09T07:54:38.125825+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T07:54:38.125825+0000","last_undegraded":"2024-05-09T07:54:38.125825+0000","last_fullsized":"2024-05-09T07:54:38.125825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114110+0000","last_change":"2024-05-09T07:54:37.105958+0000","last_active":"2024-05-09T07:54:38.114110+0000","last_peered":"2024-05-09T07:54:38.114110+0000","last_clean":"2024-05-09T07:54:38.114110+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T07:54:38.114110+0000","last_undegraded":"2024-05-09T07:54:38.114110+0000","last_fullsized":"2024-05-09T07:54:38.114110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:38.316625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089163+0000","last_change":"2024-05-09T07:54:37.090690+0000","last_active":"2024-05-09T07:54:38.089163+0000","last_peered":"2024-05-09T07:54:38.089163+0000","last_clean":"2024-05-09T07:54:38.089163+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T07:54:38.089163+0000","last_undegraded":"2024-05-09T07:54:38.089163+0000","last_fullsized":"2024-05-09T07:54:38.089163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088954+0000","last_change":"2024-05-09T07:54:37.110834+0000","last_active":"2024-05-09T07:54:38.088954+0000","last_peered":"2024-05-09T07:54:38.088954+0000","last_clean":"2024-05-09T07:54:38.088954+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T07:54:38.088954+0000","last_undegraded":"2024-05-09T07:54:38.088954+0000","last_fullsized":"2024-05-09T07:54:38.088954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090130+0000","last_change":"2024-05-09T07:54:37.099545+0000","last_active":"2024-05-09T07:54:38.090130+0000","last_peered":"2024-05-09T07:54:38.090130+0000","last_clean":"2024-05-09T07:54:38.090130+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T07:54:38.090130+0000","last_undegraded":"2024-05-09T07:54:38.090130+0000","last_fullsized":"2024-05-09T07:54:38.090130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:37.105054+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127307+0000","last_change":"2024-05-09T07:54:37.104090+0000","last_active":"2024-05-09T07:54:38.127307+0000","last_peered":"2024-05-09T07:54:38.127307+0000","last_clean":"2024-05-09T07:54:38.127307+0000","last_became_active":"2024-05-09T07:54:37.103793+0000","last_became_peered":"2024-05-09T07:54:37.103793+0000","last_unstale":"2024-05-09T07:54:38.127307+0000","last_undegraded":"2024-05-09T07:54:38.127307+0000","last_fullsized":"2024-05-09T07:54:38.127307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089303+0000","last_change":"2024-05-09T07:54:37.110846+0000","last_active":"2024-05-09T07:54:38.089303+0000","last_peered":"2024-05-09T07:54:38.089303+0000","last_clean":"2024-05-09T07:54:38.089303+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T07:54:38.089303+0000","last_undegraded":"2024-05-09T07:54:38.089303+0000","last_fullsized":"2024-05-09T07:54:38.089303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114306+0000","last_change":"2024-05-09T07:54:37.110392+0000","last_active":"2024-05-09T07:54:38.114306+0000","last_peered":"2024-05-09T07:54:38.114306+0000","last_clean":"2024-05-09T07:54:38.114306+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T07:54:38.114306+0000","last_undegraded":"2024-05-09T07:54:38.114306+0000","last_fullsized":"2024-05-09T07:54:38.114306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090055+0000","last_change":"2024-05-09T07:54:37.098797+0000","last_active":"2024-05-09T07:54:38.090055+0000","last_peered":"2024-05-09T07:54:38.090055+0000","last_clean":"2024-05-09T07:54:38.090055+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T07:54:38.090055+0000","last_undegraded":"2024-05-09T07:54:38.090055+0000","last_fullsized":"2024-05-09T07:54:38.090055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125904+0000","last_change":"2024-05-09T07:54:37.112262+0000","last_active":"2024-05-09T07:54:38.125904+0000","last_peered":"2024-05-09T07:54:38.125904+0000","last_clean":"2024-05-09T07:54:38.125904+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T07:54:38.125904+0000","last_undegraded":"2024-05-09T07:54:38.125904+0000","last_fullsized":"2024-05-09T07:54:38.125904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090032+0000","last_change":"2024-05-09T07:54:37.102723+0000","last_active":"2024-05-09T07:54:38.090032+0000","last_peered":"2024-05-09T07:54:38.090032+0000","last_clean":"2024-05-09T07:54:38.090032+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T07:54:38.090032+0000","last_undegraded":"2024-05-09T07:54:38.090032+0000","last_fullsized":"2024-05-09T07:54:38.090032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126375+0000","last_change":"2024-05-09T07:54:37.101021+0000","last_active":"2024-05-09T07:54:38.126375+0000","last_peered":"2024-05-09T07:54:38.126375+0000","last_clean":"2024-05-09T07:54:38.126375+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T07:54:38.126375+0000","last_undegraded":"2024-05-09T07:54:38.126375+0000","last_fullsized":"2024-05-09T07:54:38.126375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090192+0000","last_change":"2024-05-09T07:54:37.106515+0000","last_active":"2024-05-09T07:54:38.090192+0000","last_peered":"2024-05-09T07:54:38.090192+0000","last_clean":"2024-05-09T07:54:38.090192+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T07:54:38.090192+0000","last_undegraded":"2024-05-09T07:54:38.090192+0000","last_fullsized":"2024-05-09T07:54:38.090192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089051+0000","last_change":"2024-05-09T07:54:37.101475+0000","last_active":"2024-05-09T07:54:38.089051+0000","last_peered":"2024-05-09T07:54:38.089051+0000","last_clean":"2024-05-09T07:54:38.089051+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T07:54:38.089051+0000","last_undegraded":"2024-05-09T07:54:38.089051+0000","last_fullsized":"2024-05-09T07:54:38.089051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126288+0000","last_change":"2024-05-09T07:54:37.112908+0000","last_active":"2024-05-09T07:54:38.126288+0000","last_peered":"2024-05-09T07:54:38.126288+0000","last_clean":"2024-05-09T07:54:38.126288+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T07:54:38.126288+0000","last_undegraded":"2024-05-09T07:54:38.126288+0000","last_fullsized":"2024-05-09T07:54:38.126288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114353+0000","last_change":"2024-05-09T07:54:37.109141+0000","last_active":"2024-05-09T07:54:38.114353+0000","last_peered":"2024-05-09T07:54:38.114353+0000","last_clean":"2024-05-09T07:54:38.114353+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T07:54:38.114353+0000","last_undegraded":"2024-05-09T07:54:38.114353+0000","last_fullsized":"2024-05-09T07:54:38.114353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089775+0000","last_change":"2024-05-09T07:54:37.103105+0000","last_active":"2024-05-09T07:54:38.089775+0000","last_peered":"2024-05-09T07:54:38.089775+0000","last_clean":"2024-05-09T07:54:38.089775+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T07:54:38.089775+0000","last_undegraded":"2024-05-09T07:54:38.089775+0000","last_fullsized":"2024-05-09T07:54:38.089775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125972+0000","last_change":"2024-05-09T07:54:37.109657+0000","last_active":"2024-05-09T07:54:38.125972+0000","last_peered":"2024-05-09T07:54:38.125972+0000","last_clean":"2024-05-09T07:54:38.125972+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T07:54:38.125972+0000","last_undegraded":"2024-05-09T07:54:38.125972+0000","last_fullsized":"2024-05-09T07:54:38.125972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089035+0000","last_change":"2024-05-09T07:54:37.111278+0000","last_active":"2024-05-09T07:54:38.089035+0000","last_peered":"2024-05-09T07:54:38.089035+0000","last_clean":"2024-05-09T07:54:38.089035+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T07:54:38.089035+0000","last_undegraded":"2024-05-09T07:54:38.089035+0000","last_fullsized":"2024-05-09T07:54:38.089035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126302+0000","last_change":"2024-05-09T07:54:37.099560+0000","last_active":"2024-05-09T07:54:38.126302+0000","last_peered":"2024-05-09T07:54:38.126302+0000","last_clean":"2024-05-09T07:54:38.126302+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T07:54:38.126302+0000","last_undegraded":"2024-05-09T07:54:38.126302+0000","last_fullsized":"2024-05-09T07:54:38.126302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:30.636185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126183+0000","last_change":"2024-05-09T07:54:36.105511+0000","last_active":"2024-05-09T07:54:38.126183+0000","last_peered":"2024-05-09T07:54:38.126183+0000","last_clean":"2024-05-09T07:54:38.126183+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T07:54:38.126183+0000","last_undegraded":"2024-05-09T07:54:38.126183+0000","last_fullsized":"2024-05-09T07:54:38.126183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114445+0000","last_change":"2024-05-09T07:54:37.110626+0000","last_active":"2024-05-09T07:54:38.114445+0000","last_peered":"2024-05-09T07:54:38.114445+0000","last_clean":"2024-05-09T07:54:38.114445+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T07:54:38.114445+0000","last_undegraded":"2024-05-09T07:54:38.114445+0000","last_fullsized":"2024-05-09T07:54:38.114445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089405+0000","last_change":"2024-05-09T07:54:36.099522+0000","last_active":"2024-05-09T07:54:38.089405+0000","last_peered":"2024-05-09T07:54:38.089405+0000","last_clean":"2024-05-09T07:54:38.089405+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T07:54:38.089405+0000","last_undegraded":"2024-05-09T07:54:38.089405+0000","last_fullsized":"2024-05-09T07:54:38.089405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126052+0000","last_change":"2024-05-09T07:54:36.103352+0000","last_active":"2024-05-09T07:54:38.126052+0000","last_peered":"2024-05-09T07:54:38.126052+0000","last_clean":"2024-05-09T07:54:38.126052+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T07:54:38.126052+0000","last_undegraded":"2024-05-09T07:54:38.126052+0000","last_fullsized":"2024-05-09T07:54:38.126052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125742+0000","last_change":"2024-05-09T07:54:37.113565+0000","last_active":"2024-05-09T07:54:38.125742+0000","last_peered":"2024-05-09T07:54:38.125742+0000","last_clean":"2024-05-09T07:54:38.125742+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T07:54:38.125742+0000","last_undegraded":"2024-05-09T07:54:38.125742+0000","last_fullsized":"2024-05-09T07:54:38.125742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089786+0000","last_change":"2024-05-09T07:54:36.091893+0000","last_active":"2024-05-09T07:54:38.089786+0000","last_peered":"2024-05-09T07:54:38.089786+0000","last_clean":"2024-05-09T07:54:38.089786+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T07:54:38.089786+0000","last_undegraded":"2024-05-09T07:54:38.089786+0000","last_fullsized":"2024-05-09T07:54:38.089786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088976+0000","last_change":"2024-05-09T07:54:37.106284+0000","last_active":"2024-05-09T07:54:38.088976+0000","last_peered":"2024-05-09T07:54:38.088976+0000","last_clean":"2024-05-09T07:54:38.088976+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T07:54:38.088976+0000","last_undegraded":"2024-05-09T07:54:38.088976+0000","last_fullsized":"2024-05-09T07:54:38.088976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089802+0000","last_change":"2024-05-09T07:54:36.100068+0000","last_active":"2024-05-09T07:54:38.089802+0000","last_peered":"2024-05-09T07:54:38.089802+0000","last_clean":"2024-05-09T07:54:38.089802+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T07:54:38.089802+0000","last_undegraded":"2024-05-09T07:54:38.089802+0000","last_fullsized":"2024-05-09T07:54:38.089802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089637+0000","last_change":"2024-05-09T07:54:37.099653+0000","last_active":"2024-05-09T07:54:38.089637+0000","last_peered":"2024-05-09T07:54:38.089637+0000","last_clean":"2024-05-09T07:54:38.089637+0000","last_became_active":"2024-05-09T07:54:37.099256+0000","last_became_peered":"2024-05-09T07:54:37.099256+0000","last_unstale":"2024-05-09T07:54:38.089637+0000","last_undegraded":"2024-05-09T07:54:38.089637+0000","last_fullsized":"2024-05-09T07:54:38.089637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090072+0000","last_change":"2024-05-09T07:54:36.100368+0000","last_active":"2024-05-09T07:54:38.090072+0000","last_peered":"2024-05-09T07:54:38.090072+0000","last_clean":"2024-05-09T07:54:38.090072+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T07:54:38.090072+0000","last_undegraded":"2024-05-09T07:54:38.090072+0000","last_fullsized":"2024-05-09T07:54:38.090072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114311+0000","last_change":"2024-05-09T07:54:37.107847+0000","last_active":"2024-05-09T07:54:38.114311+0000","last_peered":"2024-05-09T07:54:38.114311+0000","last_clean":"2024-05-09T07:54:38.114311+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T07:54:38.114311+0000","last_undegraded":"2024-05-09T07:54:38.114311+0000","last_fullsized":"2024-05-09T07:54:38.114311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089184+0000","last_change":"2024-05-09T07:54:36.101694+0000","last_active":"2024-05-09T07:54:38.089184+0000","last_peered":"2024-05-09T07:54:38.089184+0000","last_clean":"2024-05-09T07:54:38.089184+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T07:54:38.089184+0000","last_undegraded":"2024-05-09T07:54:38.089184+0000","last_fullsized":"2024-05-09T07:54:38.089184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126626+0000","last_change":"2024-05-09T07:54:37.098733+0000","last_active":"2024-05-09T07:54:38.126626+0000","last_peered":"2024-05-09T07:54:38.126626+0000","last_clean":"2024-05-09T07:54:38.126626+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T07:54:38.126626+0000","last_undegraded":"2024-05-09T07:54:38.126626+0000","last_fullsized":"2024-05-09T07:54:38.126626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:15.571989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089966+0000","last_change":"2024-05-09T07:54:36.103096+0000","last_active":"2024-05-09T07:54:38.089966+0000","last_peered":"2024-05-09T07:54:38.089966+0000","last_clean":"2024-05-09T07:54:38.089966+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T07:54:38.089966+0000","last_undegraded":"2024-05-09T07:54:38.089966+0000","last_fullsized":"2024-05-09T07:54:38.089966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127096+0000","last_change":"2024-05-09T07:54:37.101875+0000","last_active":"2024-05-09T07:54:38.127096+0000","last_peered":"2024-05-09T07:54:38.127096+0000","last_clean":"2024-05-09T07:54:38.127096+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T07:54:38.127096+0000","last_undegraded":"2024-05-09T07:54:38.127096+0000","last_fullsized":"2024-05-09T07:54:38.127096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114462+0000","last_change":"2024-05-09T07:54:36.090977+0000","last_active":"2024-05-09T07:54:38.114462+0000","last_peered":"2024-05-09T07:54:38.114462+0000","last_clean":"2024-05-09T07:54:38.114462+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T07:54:38.114462+0000","last_undegraded":"2024-05-09T07:54:38.114462+0000","last_fullsized":"2024-05-09T07:54:38.114462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:17.768144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114204+0000","last_change":"2024-05-09T07:54:37.105813+0000","last_active":"2024-05-09T07:54:38.114204+0000","last_peered":"2024-05-09T07:54:38.114204+0000","last_clean":"2024-05-09T07:54:38.114204+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T07:54:38.114204+0000","last_undegraded":"2024-05-09T07:54:38.114204+0000","last_fullsized":"2024-05-09T07:54:38.114204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:02.185354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089886+0000","last_change":"2024-05-09T07:54:36.102510+0000","last_active":"2024-05-09T07:54:38.089886+0000","last_peered":"2024-05-09T07:54:38.089886+0000","last_clean":"2024-05-09T07:54:38.089886+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T07:54:38.089886+0000","last_undegraded":"2024-05-09T07:54:38.089886+0000","last_fullsized":"2024-05-09T07:54:38.089886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126997+0000","last_change":"2024-05-09T07:54:37.105015+0000","last_active":"2024-05-09T07:54:38.126997+0000","last_peered":"2024-05-09T07:54:38.126997+0000","last_clean":"2024-05-09T07:54:38.126997+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T07:54:38.126997+0000","last_undegraded":"2024-05-09T07:54:38.126997+0000","last_fullsized":"2024-05-09T07:54:38.126997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089058+0000","last_change":"2024-05-09T07:54:36.103721+0000","last_active":"2024-05-09T07:54:38.089058+0000","last_peered":"2024-05-09T07:54:38.089058+0000","last_clean":"2024-05-09T07:54:38.089058+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T07:54:38.089058+0000","last_undegraded":"2024-05-09T07:54:38.089058+0000","last_fullsized":"2024-05-09T07:54:38.089058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088980+0000","last_change":"2024-05-09T07:54:37.111215+0000","last_active":"2024-05-09T07:54:38.088980+0000","last_peered":"2024-05-09T07:54:38.088980+0000","last_clean":"2024-05-09T07:54:38.088980+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T07:54:38.088980+0000","last_undegraded":"2024-05-09T07:54:38.088980+0000","last_fullsized":"2024-05-09T07:54:38.088980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125695+0000","last_change":"2024-05-09T07:54:36.098598+0000","last_active":"2024-05-09T07:54:38.125695+0000","last_peered":"2024-05-09T07:54:38.125695+0000","last_clean":"2024-05-09T07:54:38.125695+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T07:54:38.125695+0000","last_undegraded":"2024-05-09T07:54:38.125695+0000","last_fullsized":"2024-05-09T07:54:38.125695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126550+0000","last_change":"2024-05-09T07:54:37.102764+0000","last_active":"2024-05-09T07:54:38.126550+0000","last_peered":"2024-05-09T07:54:38.126550+0000","last_clean":"2024-05-09T07:54:38.126550+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T07:54:38.126550+0000","last_undegraded":"2024-05-09T07:54:38.126550+0000","last_fullsized":"2024-05-09T07:54:38.126550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126466+0000","last_change":"2024-05-09T07:54:36.092365+0000","last_active":"2024-05-09T07:54:38.126466+0000","last_peered":"2024-05-09T07:54:38.126466+0000","last_clean":"2024-05-09T07:54:38.126466+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T07:54:38.126466+0000","last_undegraded":"2024-05-09T07:54:38.126466+0000","last_fullsized":"2024-05-09T07:54:38.126466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127009+0000","last_change":"2024-05-09T07:54:37.100214+0000","last_active":"2024-05-09T07:54:38.127009+0000","last_peered":"2024-05-09T07:54:38.127009+0000","last_clean":"2024-05-09T07:54:38.127009+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T07:54:38.127009+0000","last_undegraded":"2024-05-09T07:54:38.127009+0000","last_fullsized":"2024-05-09T07:54:38.127009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126065+0000","last_change":"2024-05-09T07:54:36.100004+0000","last_active":"2024-05-09T07:54:38.126065+0000","last_peered":"2024-05-09T07:54:38.126065+0000","last_clean":"2024-05-09T07:54:38.126065+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T07:54:38.126065+0000","last_undegraded":"2024-05-09T07:54:38.126065+0000","last_fullsized":"2024-05-09T07:54:38.126065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127108+0000","last_change":"2024-05-09T07:54:37.100879+0000","last_active":"2024-05-09T07:54:38.127108+0000","last_peered":"2024-05-09T07:54:38.127108+0000","last_clean":"2024-05-09T07:54:38.127108+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T07:54:38.127108+0000","last_undegraded":"2024-05-09T07:54:38.127108+0000","last_fullsized":"2024-05-09T07:54:38.127108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089145+0000","last_change":"2024-05-09T07:54:36.099594+0000","last_active":"2024-05-09T07:54:38.089145+0000","last_peered":"2024-05-09T07:54:38.089145+0000","last_clean":"2024-05-09T07:54:38.089145+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T07:54:38.089145+0000","last_undegraded":"2024-05-09T07:54:38.089145+0000","last_fullsized":"2024-05-09T07:54:38.089145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090354+0000","last_change":"2024-05-09T07:54:37.103885+0000","last_active":"2024-05-09T07:54:38.090354+0000","last_peered":"2024-05-09T07:54:38.090354+0000","last_clean":"2024-05-09T07:54:38.090354+0000","last_became_active":"2024-05-09T07:54:37.103150+0000","last_became_peered":"2024-05-09T07:54:37.103150+0000","last_unstale":"2024-05-09T07:54:38.090354+0000","last_undegraded":"2024-05-09T07:54:38.090354+0000","last_fullsized":"2024-05-09T07:54:38.090354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:16:02.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125835+0000","last_change":"2024-05-09T07:54:36.097398+0000","last_active":"2024-05-09T07:54:38.125835+0000","last_peered":"2024-05-09T07:54:38.125835+0000","last_clean":"2024-05-09T07:54:38.125835+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T07:54:38.125835+0000","last_undegraded":"2024-05-09T07:54:38.125835+0000","last_fullsized":"2024-05-09T07:54:38.125835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127276+0000","last_change":"2024-05-09T07:54:37.108574+0000","last_active":"2024-05-09T07:54:38.127276+0000","last_peered":"2024-05-09T07:54:38.127276+0000","last_clean":"2024-05-09T07:54:38.127276+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T07:54:38.127276+0000","last_undegraded":"2024-05-09T07:54:38.127276+0000","last_fullsized":"2024-05-09T07:54:38.127276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126041+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:54:38.126041+0000","last_peered":"2024-05-09T07:54:38.126041+0000","last_clean":"2024-05-09T07:54:38.126041+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:54:38.126041+0000","last_undegraded":"2024-05-09T07:54:38.126041+0000","last_fullsized":"2024-05-09T07:54:38.126041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089307+0000","last_change":"2024-05-09T07:54:36.097635+0000","last_active":"2024-05-09T07:54:38.089307+0000","last_peered":"2024-05-09T07:54:38.089307+0000","last_clean":"2024-05-09T07:54:38.089307+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T07:54:38.089307+0000","last_undegraded":"2024-05-09T07:54:38.089307+0000","last_fullsized":"2024-05-09T07:54:38.089307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125983+0000","last_change":"2024-05-09T07:54:37.111470+0000","last_active":"2024-05-09T07:54:38.125983+0000","last_peered":"2024-05-09T07:54:38.125983+0000","last_clean":"2024-05-09T07:54:38.125983+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T07:54:38.125983+0000","last_undegraded":"2024-05-09T07:54:38.125983+0000","last_fullsized":"2024-05-09T07:54:38.125983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126209+0000","last_change":"2024-05-09T07:54:36.107162+0000","last_active":"2024-05-09T07:54:38.126209+0000","last_peered":"2024-05-09T07:54:38.126209+0000","last_clean":"2024-05-09T07:54:38.126209+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T07:54:38.126209+0000","last_undegraded":"2024-05-09T07:54:38.126209+0000","last_fullsized":"2024-05-09T07:54:38.126209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114106+0000","last_change":"2024-05-09T07:54:37.102062+0000","last_active":"2024-05-09T07:54:38.114106+0000","last_peered":"2024-05-09T07:54:38.114106+0000","last_clean":"2024-05-09T07:54:38.114106+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T07:54:38.114106+0000","last_undegraded":"2024-05-09T07:54:38.114106+0000","last_fullsized":"2024-05-09T07:54:38.114106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:32.555846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125875+0000","last_change":"2024-05-09T07:54:36.100227+0000","last_active":"2024-05-09T07:54:38.125875+0000","last_peered":"2024-05-09T07:54:38.125875+0000","last_clean":"2024-05-09T07:54:38.125875+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T07:54:38.125875+0000","last_undegraded":"2024-05-09T07:54:38.125875+0000","last_fullsized":"2024-05-09T07:54:38.125875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089178+0000","last_change":"2024-05-09T07:54:37.109167+0000","last_active":"2024-05-09T07:54:38.089178+0000","last_peered":"2024-05-09T07:54:38.089178+0000","last_clean":"2024-05-09T07:54:38.089178+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T07:54:38.089178+0000","last_undegraded":"2024-05-09T07:54:38.089178+0000","last_fullsized":"2024-05-09T07:54:38.089178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090002+0000","last_change":"2024-05-09T07:54:36.100426+0000","last_active":"2024-05-09T07:54:38.090002+0000","last_peered":"2024-05-09T07:54:38.090002+0000","last_clean":"2024-05-09T07:54:38.090002+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T07:54:38.090002+0000","last_undegraded":"2024-05-09T07:54:38.090002+0000","last_fullsized":"2024-05-09T07:54:38.090002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126610+0000","last_change":"2024-05-09T07:54:37.108794+0000","last_active":"2024-05-09T07:54:38.126610+0000","last_peered":"2024-05-09T07:54:38.126610+0000","last_clean":"2024-05-09T07:54:38.126610+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T07:54:38.126610+0000","last_undegraded":"2024-05-09T07:54:38.126610+0000","last_fullsized":"2024-05-09T07:54:38.126610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:43.498827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089162+0000","last_change":"2024-05-09T07:54:36.104155+0000","last_active":"2024-05-09T07:54:38.089162+0000","last_peered":"2024-05-09T07:54:38.089162+0000","last_clean":"2024-05-09T07:54:38.089162+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T07:54:38.089162+0000","last_undegraded":"2024-05-09T07:54:38.089162+0000","last_fullsized":"2024-05-09T07:54:38.089162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090218+0000","last_change":"2024-05-09T07:54:37.103562+0000","last_active":"2024-05-09T07:54:38.090218+0000","last_peered":"2024-05-09T07:54:38.090218+0000","last_clean":"2024-05-09T07:54:38.090218+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T07:54:38.090218+0000","last_undegraded":"2024-05-09T07:54:38.090218+0000","last_fullsized":"2024-05-09T07:54:38.090218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127376+0000","last_change":"2024-05-09T07:54:36.106399+0000","last_active":"2024-05-09T07:54:38.127376+0000","last_peered":"2024-05-09T07:54:38.127376+0000","last_clean":"2024-05-09T07:54:38.127376+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T07:54:38.127376+0000","last_undegraded":"2024-05-09T07:54:38.127376+0000","last_fullsized":"2024-05-09T07:54:38.127376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089072+0000","last_change":"2024-05-09T07:54:37.105988+0000","last_active":"2024-05-09T07:54:38.089072+0000","last_peered":"2024-05-09T07:54:38.089072+0000","last_clean":"2024-05-09T07:54:38.089072+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T07:54:38.089072+0000","last_undegraded":"2024-05-09T07:54:38.089072+0000","last_fullsized":"2024-05-09T07:54:38.089072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.102035+0000","last_change":"2024-05-09T07:54:36.101002+0000","last_active":"2024-05-09T07:54:38.102035+0000","last_peered":"2024-05-09T07:54:38.102035+0000","last_clean":"2024-05-09T07:54:38.102035+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T07:54:38.102035+0000","last_undegraded":"2024-05-09T07:54:38.102035+0000","last_fullsized":"2024-05-09T07:54:38.102035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126405+0000","last_change":"2024-05-09T07:54:37.100183+0000","last_active":"2024-05-09T07:54:38.126405+0000","last_peered":"2024-05-09T07:54:38.126405+0000","last_clean":"2024-05-09T07:54:38.126405+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T07:54:38.126405+0000","last_undegraded":"2024-05-09T07:54:38.126405+0000","last_fullsized":"2024-05-09T07:54:38.126405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089901+0000","last_change":"2024-05-09T07:54:36.105813+0000","last_active":"2024-05-09T07:54:38.089901+0000","last_peered":"2024-05-09T07:54:38.089901+0000","last_clean":"2024-05-09T07:54:38.089901+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T07:54:38.089901+0000","last_undegraded":"2024-05-09T07:54:38.089901+0000","last_fullsized":"2024-05-09T07:54:38.089901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114359+0000","last_change":"2024-05-09T07:54:37.107782+0000","last_active":"2024-05-09T07:54:38.114359+0000","last_peered":"2024-05-09T07:54:38.114359+0000","last_clean":"2024-05-09T07:54:38.114359+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T07:54:38.114359+0000","last_undegraded":"2024-05-09T07:54:38.114359+0000","last_fullsized":"2024-05-09T07:54:38.114359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125962+0000","last_change":"2024-05-09T07:54:36.106409+0000","last_active":"2024-05-09T07:54:38.125962+0000","last_peered":"2024-05-09T07:54:38.125962+0000","last_clean":"2024-05-09T07:54:38.125962+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T07:54:38.125962+0000","last_undegraded":"2024-05-09T07:54:38.125962+0000","last_fullsized":"2024-05-09T07:54:38.125962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126537+0000","last_change":"2024-05-09T07:54:37.104920+0000","last_active":"2024-05-09T07:54:38.126537+0000","last_peered":"2024-05-09T07:54:38.126537+0000","last_clean":"2024-05-09T07:54:38.126537+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T07:54:38.126537+0000","last_undegraded":"2024-05-09T07:54:38.126537+0000","last_fullsized":"2024-05-09T07:54:38.126537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089089+0000","last_change":"2024-05-09T07:54:36.105662+0000","last_active":"2024-05-09T07:54:38.089089+0000","last_peered":"2024-05-09T07:54:38.089089+0000","last_clean":"2024-05-09T07:54:38.089089+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T07:54:38.089089+0000","last_undegraded":"2024-05-09T07:54:38.089089+0000","last_fullsized":"2024-05-09T07:54:38.089089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.125906+0000","last_change":"2024-05-09T07:54:37.103640+0000","last_active":"2024-05-09T07:54:38.125906+0000","last_peered":"2024-05-09T07:54:38.125906+0000","last_clean":"2024-05-09T07:54:38.125906+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T07:54:38.125906+0000","last_undegraded":"2024-05-09T07:54:38.125906+0000","last_fullsized":"2024-05-09T07:54:38.125906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089139+0000","last_change":"2024-05-09T07:54:36.102636+0000","last_active":"2024-05-09T07:54:38.089139+0000","last_peered":"2024-05-09T07:54:38.089139+0000","last_clean":"2024-05-09T07:54:38.089139+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T07:54:38.089139+0000","last_undegraded":"2024-05-09T07:54:38.089139+0000","last_fullsized":"2024-05-09T07:54:38.089139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126076+0000","last_change":"2024-05-09T07:54:37.113734+0000","last_active":"2024-05-09T07:54:38.126076+0000","last_peered":"2024-05-09T07:54:38.126076+0000","last_clean":"2024-05-09T07:54:38.126076+0000","last_became_active":"2024-05-09T07:54:37.113448+0000","last_became_peered":"2024-05-09T07:54:37.113448+0000","last_unstale":"2024-05-09T07:54:38.126076+0000","last_undegraded":"2024-05-09T07:54:38.126076+0000","last_fullsized":"2024-05-09T07:54:38.126076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127166+0000","last_change":"2024-05-09T07:54:36.104367+0000","last_active":"2024-05-09T07:54:38.127166+0000","last_peered":"2024-05-09T07:54:38.127166+0000","last_clean":"2024-05-09T07:54:38.127166+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T07:54:38.127166+0000","last_undegraded":"2024-05-09T07:54:38.127166+0000","last_fullsized":"2024-05-09T07:54:38.127166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.088985+0000","last_change":"2024-05-09T07:54:37.111038+0000","last_active":"2024-05-09T07:54:38.088985+0000","last_peered":"2024-05-09T07:54:38.088985+0000","last_clean":"2024-05-09T07:54:38.088985+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T07:54:38.088985+0000","last_undegraded":"2024-05-09T07:54:38.088985+0000","last_fullsized":"2024-05-09T07:54:38.088985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.089727+0000","last_change":"2024-05-09T07:54:37.091699+0000","last_active":"2024-05-09T07:54:38.089727+0000","last_peered":"2024-05-09T07:54:38.089727+0000","last_clean":"2024-05-09T07:54:38.089727+0000","last_became_active":"2024-05-09T07:54:37.091280+0000","last_became_peered":"2024-05-09T07:54:37.091280+0000","last_unstale":"2024-05-09T07:54:38.089727+0000","last_undegraded":"2024-05-09T07:54:38.089727+0000","last_fullsized":"2024-05-09T07:54:38.089727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127058+0000","last_change":"2024-05-09T07:54:36.105726+0000","last_active":"2024-05-09T07:54:38.127058+0000","last_peered":"2024-05-09T07:54:38.127058+0000","last_clean":"2024-05-09T07:54:38.127058+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T07:54:38.127058+0000","last_undegraded":"2024-05-09T07:54:38.127058+0000","last_fullsized":"2024-05-09T07:54:38.127058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.090261+0000","last_change":"2024-05-09T07:54:37.092061+0000","last_active":"2024-05-09T07:54:38.090261+0000","last_peered":"2024-05-09T07:54:38.090261+0000","last_clean":"2024-05-09T07:54:38.090261+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T07:54:38.090261+0000","last_undegraded":"2024-05-09T07:54:38.090261+0000","last_fullsized":"2024-05-09T07:54:38.090261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.127214+0000","last_change":"2024-05-09T07:54:36.106635+0000","last_active":"2024-05-09T07:54:38.127214+0000","last_peered":"2024-05-09T07:54:38.127214+0000","last_clean":"2024-05-09T07:54:38.127214+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T07:54:38.127214+0000","last_undegraded":"2024-05-09T07:54:38.127214+0000","last_fullsized":"2024-05-09T07:54:38.127214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114272+0000","last_change":"2024-05-09T07:54:37.108470+0000","last_active":"2024-05-09T07:54:38.114272+0000","last_peered":"2024-05-09T07:54:38.114272+0000","last_clean":"2024-05-09T07:54:38.114272+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T07:54:38.114272+0000","last_undegraded":"2024-05-09T07:54:38.114272+0000","last_fullsized":"2024-05-09T07:54:38.114272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126415+0000","last_change":"2024-05-09T07:54:36.102502+0000","last_active":"2024-05-09T07:54:38.126415+0000","last_peered":"2024-05-09T07:54:38.126415+0000","last_clean":"2024-05-09T07:54:38.126415+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T07:54:38.126415+0000","last_undegraded":"2024-05-09T07:54:38.126415+0000","last_fullsized":"2024-05-09T07:54:38.126415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.126360+0000","last_change":"2024-05-09T07:54:37.104598+0000","last_active":"2024-05-09T07:54:38.126360+0000","last_peered":"2024-05-09T07:54:38.126360+0000","last_clean":"2024-05-09T07:54:38.126360+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T07:54:38.126360+0000","last_undegraded":"2024-05-09T07:54:38.126360+0000","last_fullsized":"2024-05-09T07:54:38.126360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-09T07:54:38.114410+0000","last_change":"2024-05-09T07:54:36.101744+0000","last_active":"2024-05-09T07:54:38.114410+0000","last_peered":"2024-05-09T07:54:38.114410+0000","last_clean":"2024-05-09T07:54:38.114410+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T07:54:38.114410+0000","last_undegraded":"2024-05-09T07:54:38.114410+0000","last_fullsized":"2024-05-09T07:54:38.114410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":666051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":665995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":76657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":76657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":75045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T07:54:49.489 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T07:54:49.489 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T07:54:49.489 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-09T07:54:49.489 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T07:54:49.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.608+0000 7f7800a31640 1 Processor -- start 2024-05-09T07:54:49.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.608+0000 7f7800a31640 1 -- start start 2024-05-09T07:54:49.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.609+0000 7f7800a31640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc0b4fb0 0x7f77fc0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.624 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.609+0000 7f7800a31640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77fc141d20 0x7f77fc0b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.609+0000 7f7800a31640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77fc0b61b0 con 0x7f77fc0b5dd0 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.609+0000 7f7800a31640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f77fc0b7fc0 con 0x7f77fc141d20 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.609+0000 7f7800a31640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f77fc0b99b0 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.609+0000 7f77fad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f77fc141d20 0x7f77fc0b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.609+0000 7f77fa59c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f77fc0b5dd0 0x7f77fc141610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43726/0 (socket says 172.21.15.87:43726) 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.609+0000 7f77fa59c640 1 -- 172.21.15.87:0/4181309215 learned_addr learned my addr 172.21.15.87:0/4181309215 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77f9d9b640 1 --2- 172.21.15.87:0/4181309215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc0b4fb0 0x7f77fc0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77fad9d640 1 -- 172.21.15.87:0/4181309215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc0b4fb0 msgr2=0x7f77fc0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77fad9d640 1 --2- 172.21.15.87:0/4181309215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc0b4fb0 0x7f77fc0b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77fad9d640 1 -- 172.21.15.87:0/4181309215 >> v1:172.21.15.87:6789/0 conn(0x7f77fc0b5dd0 legacy=0x7f77fc141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77fad9d640 1 -- 172.21.15.87:0/4181309215 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc147a50 con 0x7f77fc141d20 2024-05-09T07:54:49.625 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77f959a640 1 -- 172.21.15.87:0/4181309215 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212513963 0 0) 0x7f77fc0b61b0 con 0x7f77fc0b5dd0 2024-05-09T07:54:49.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77fad9d640 1 --2- 172.21.15.87:0/4181309215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc141d20 0x7f77fc0b7a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0097d0 tx=0x7f77ec02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4624baf39249f36f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:49.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77f959a640 1 -- 172.21.15.87:0/4181309215 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec037070 con 0x7f77fc141d20 2024-05-09T07:54:49.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77f959a640 1 -- 172.21.15.87:0/4181309215 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ec02ae40 con 0x7f77fc141d20 2024-05-09T07:54:49.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.610+0000 7f77f959a640 1 -- 172.21.15.87:0/4181309215 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec032660 con 0x7f77fc141d20 2024-05-09T07:54:49.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.611+0000 7f7800a31640 1 -- 172.21.15.87:0/4181309215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc141d20 msgr2=0x7f77fc0b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.611+0000 7f7800a31640 1 --2- 172.21.15.87:0/4181309215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc141d20 0x7f77fc0b7a80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0097d0 tx=0x7f77ec02a130 comp rx=0 tx=0).stop 2024-05-09T07:54:49.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.611+0000 7f7800a31640 1 -- 172.21.15.87:0/4181309215 shutdown_connections 2024-05-09T07:54:49.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.611+0000 7f7800a31640 1 --2- 172.21.15.87:0/4181309215 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc141d20 0x7f77fc0b7a80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.611+0000 7f7800a31640 1 --2- 172.21.15.87:0/4181309215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc0b4fb0 0x7f77fc0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.611+0000 7f7800a31640 1 -- 172.21.15.87:0/4181309215 >> 172.21.15.87:0/4181309215 conn(0x7f77fc067870 msgr2=0x7f77fc0bd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:49.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.611+0000 7f7800a31640 1 -- 172.21.15.87:0/4181309215 shutdown_connections 2024-05-09T07:54:49.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.611+0000 7f7800a31640 1 -- 172.21.15.87:0/4181309215 wait complete. 2024-05-09T07:54:49.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.612+0000 7f7800a31640 1 Processor -- start 2024-05-09T07:54:49.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.612+0000 7f7800a31640 1 -- start start 2024-05-09T07:54:49.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f7800a31640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc0b4fb0 0x7f77fc14a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f7800a31640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77fc0b5dd0 0x7f77fc14b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f7800a31640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc141d20 0x7f77fc1e03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f7800a31640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc148530 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f7800a31640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc148010 con 0x7f77fc0b5dd0 2024-05-09T07:54:49.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f7800a31640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f77fc1486b0 con 0x7f77fc141d20 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc0b4fb0 0x7f77fc14a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc0b4fb0 0x7f77fc14a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56012/0 (socket says 172.21.15.87:56012) 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fa59c640 1 -- 172.21.15.87:0/3285376387 learned_addr learned my addr 172.21.15.87:0/3285376387 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fad9d640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc141d20 0x7f77fc1e03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77f9d9b640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77fc0b5dd0 0x7f77fc14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fa59c640 1 -- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc141d20 msgr2=0x7f77fc1e03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fa59c640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc141d20 0x7f77fc1e03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fa59c640 1 -- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77fc0b5dd0 msgr2=0x7f77fc14b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fa59c640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77fc0b5dd0 0x7f77fc14b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fa59c640 1 -- 172.21.15.87:0/3285376387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc1d4a80 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77f9d9b640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77fc0b5dd0 0x7f77fc14b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.613+0000 7f77fad9d640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc141d20 0x7f77fc1e03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.614+0000 7f77fa59c640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc0b4fb0 0x7f77fc14a3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c8c0 tx=0x7f77f400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.614+0000 7f77f2ffd640 1 -- 172.21.15.87:0/3285376387 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4018070 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.614+0000 7f77f2ffd640 1 -- 172.21.15.87:0/3285376387 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f400a640 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.614+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc1d13f0 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.614+0000 7f77f2ffd640 1 -- 172.21.15.87:0/3285376387 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f400aa30 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.614+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc149bf0 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.615+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77fc0691f0 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.615+0000 7f77f2ffd640 1 -- 172.21.15.87:0/3285376387 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77f401b070 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.616+0000 7f77f2ffd640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f77dc06be60 0x7f77dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.616+0000 7f77f2ffd640 1 -- 172.21.15.87:0/3285376387 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f77f408a460 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.616+0000 7f77f9d9b640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f77dc06be60 0x7f77dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.616+0000 7f77f9d9b640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f77dc06be60 0x7f77dc06e320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0b7f10 tx=0x7f77e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:49.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.620+0000 7f77f2ffd640 1 -- 172.21.15.87:0/3285376387 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f77f4058ea0 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.828+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f77fc140d10 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.843 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.828+0000 7f77f2ffd640 1 -- 172.21.15.87:0/3285376387 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f77f40587a0 con 0x7f77fc0b4fb0 2024-05-09T07:54:49.843 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:49.843 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T07:54:49.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f77dc06be60 msgr2=0x7f77dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f77dc06be60 0x7f77dc06e320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0b7f10 tx=0x7f77e4008040 comp rx=0 tx=0).stop 2024-05-09T07:54:49.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc0b4fb0 msgr2=0x7f77fc14a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc0b4fb0 0x7f77fc14a3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c8c0 tx=0x7f77f400cd80 comp rx=0 tx=0).stop 2024-05-09T07:54:49.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 shutdown_connections 2024-05-09T07:54:49.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f77dc06be60 0x7f77dc06e320 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.845 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77fc141d20 0x7f77fc1e03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77fc0b5dd0 0x7f77fc14b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 --2- 172.21.15.87:0/3285376387 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f77fc0b4fb0 0x7f77fc14a3f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 >> 172.21.15.87:0/3285376387 conn(0x7f77fc067870 msgr2=0x7f77fc140270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 shutdown_connections 2024-05-09T07:54:49.846 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.830+0000 7f7800a31640 1 -- 172.21.15.87:0/3285376387 wait complete. 2024-05-09T07:54:49.856 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-09T07:54:49.856 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:49.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.942+0000 7f68a3f16640 1 Processor -- start 2024-05-09T07:54:49.957 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.942+0000 7f68a3f16640 1 -- start start 2024-05-09T07:54:49.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.942+0000 7f68a3f16640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f689c0b5a10 0x7f689c147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.963 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.942+0000 7f68a3f16640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689c0af330 con 0x7f689c0b5630 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.942+0000 7f68a3f16640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689c06e9e0 con 0x7f689c0b0290 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.942+0000 7f68a3f16640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f689c073150 con 0x7f689c0b5a10 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a1cb2640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f689c0b5630 0x7f689c06b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43730/0 (socket says 172.21.15.87:43730) 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a1cb2640 1 -- 172.21.15.87:0/287943498 learned_addr learned my addr 172.21.15.87:0/287943498 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a14b1640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f689c0b5a10 0x7f689c147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651987076 0 0) 0x7f689c0af330 con 0x7f689c0b5630 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6888003520 con 0x7f689c0b5630 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362988341 0 0) 0x7f689c06e9e0 con 0x7f689c0b0290 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f689c0af330 con 0x7f689c0b0290 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1697930387 0 0) 0x7f6888003520 con 0x7f689c0b5630 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f689c0b5a10 msgr2=0x7f689c147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f689c0b5a10 0x7f689c147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 >> v1:172.21.15.110:6789/0 conn(0x7f689c0b0290 legacy=0x7f689c148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.964 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c0b4ba0 con 0x7f689c0b5630 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f6898001670 con 0x7f689c0b5630 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 >> v1:172.21.15.87:6789/0 conn(0x7f689c0b5630 legacy=0x7f689c06b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f689c0b5a10 0x7f6888003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880040d0 0x7f6888004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6888004d40 0x7f68880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f689c073150 con 0x7f68880040d0 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f688800baa0 con 0x7f6888004d40 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f688800bca0 con 0x7f689c0b5a10 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a14b1640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880040d0 0x7f6888004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a1cb2640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f689c0b5a10 0x7f6888003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.943+0000 7f68a24b3640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6888004d40 0x7f68880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.944+0000 7f68a14b1640 1 -- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f689c0b5a10 msgr2=0x7f6888003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.944+0000 7f68a14b1640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f689c0b5a10 0x7f6888003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.965 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.944+0000 7f68a14b1640 1 -- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6888004d40 msgr2=0x7f68880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.944+0000 7f68a14b1640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6888004d40 0x7f68880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.944+0000 7f68a14b1640 1 -- 172.21.15.87:0/287943498 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888003520 con 0x7f68880040d0 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.944+0000 7f68a14b1640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880040d0 0x7f6888004800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f688c009a90 tx=0x7f6888005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50f715d9d7c5407 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.944+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c036070 con 0x7f68880040d0 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.944+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688c031400 con 0x7f68880040d0 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.944+0000 7f68a0cb0640 1 -- 172.21.15.87:0/287943498 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c009690 con 0x7f68880040d0 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.945+0000 7f68a3f16640 1 -- 172.21.15.87:0/287943498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880040d0 msgr2=0x7f6888004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.945+0000 7f68a3f16640 1 --2- 172.21.15.87:0/287943498 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f68880040d0 0x7f6888004800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f688c009a90 tx=0x7f6888005830 comp rx=0 tx=0).stop 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.945+0000 7f68a24b3640 1 -- 172.21.15.87:0/287943498 reap_dead start 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.945+0000 7f68a3f16640 1 -- 172.21.15.87:0/287943498 shutdown_connections 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.945+0000 7f68a3f16640 1 -- 172.21.15.87:0/287943498 >> 172.21.15.87:0/287943498 conn(0x7f689c0b68e0 msgr2=0x7f689c0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.945+0000 7f68a3f16640 1 -- 172.21.15.87:0/287943498 shutdown_connections 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.945+0000 7f68a3f16640 1 -- 172.21.15.87:0/287943498 wait complete. 2024-05-09T07:54:49.966 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.946+0000 7f68a3f16640 1 Processor -- start 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.946+0000 7f68a3f16640 1 -- start start 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.946+0000 7f68a3f16640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68880040d0 0x7f689c1e0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.946+0000 7f68a3f16640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c1dcb50 0x7f689c13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.946+0000 7f68a3f16640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f689c140100 0x7f689c1431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.946+0000 7f68a3f16640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f689c0af050 con 0x7f689c140100 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.946+0000 7f68a3f16640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f689c0afe00 con 0x7f689c1dcb50 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.946+0000 7f68a3f16640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f689c0b4880 con 0x7f68880040d0 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a24b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f689c140100 0x7f689c1431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a24b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f689c140100 0x7f689c1431d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56038/0 (socket says 172.21.15.87:56038) 2024-05-09T07:54:49.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a24b3640 1 -- 172.21.15.87:0/51972734 learned_addr learned my addr 172.21.15.87:0/51972734 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a14b1640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c1dcb50 0x7f689c13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a1cb2640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68880040d0 0x7f689c1e0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a24b3640 1 -- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68880040d0 msgr2=0x7f689c1e0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a24b3640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68880040d0 0x7f689c1e0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a24b3640 1 -- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c1dcb50 msgr2=0x7f689c13fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a24b3640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c1dcb50 0x7f689c13fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a24b3640 1 -- 172.21.15.87:0/51972734 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c1dcfb0 con 0x7f689c140100 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a1cb2640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68880040d0 0x7f689c1e0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a14b1640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c1dcb50 0x7f689c13fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:49.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a24b3640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f689c140100 0x7f689c1431d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f689c0b06e0 tx=0x7f689400fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:49.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68927fc640 1 -- 172.21.15.87:0/51972734 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894019070 con 0x7f689c140100 2024-05-09T07:54:49.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68927fc640 1 -- 172.21.15.87:0/51972734 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6894006e20 con 0x7f689c140100 2024-05-09T07:54:49.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689c1413d0 con 0x7f689c140100 2024-05-09T07:54:49.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68927fc640 1 -- 172.21.15.87:0/51972734 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894003b90 con 0x7f689c140100 2024-05-09T07:54:49.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.947+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689c1e04a0 con 0x7f689c140100 2024-05-09T07:54:49.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.948+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689c0691f0 con 0x7f689c140100 2024-05-09T07:54:49.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.949+0000 7f68927fc640 1 -- 172.21.15.87:0/51972734 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68940050d0 con 0x7f689c140100 2024-05-09T07:54:49.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.949+0000 7f68927fc640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f688006be60 0x7f688006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:49.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.949+0000 7f68a1cb2640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f688006be60 0x7f688006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:49.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.949+0000 7f68927fc640 1 -- 172.21.15.87:0/51972734 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f689408a2c0 con 0x7f689c140100 2024-05-09T07:54:49.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.950+0000 7f68a1cb2640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f688006be60 0x7f688006e320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6898007d20 tx=0x7f6898009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:49.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:49.954+0000 7f68927fc640 1 -- 172.21.15.87:0/51972734 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6894058d00 con 0x7f689c140100 2024-05-09T07:54:50.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.128+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f689c06b9a0 con 0x7f689c140100 2024-05-09T07:54:50.144 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.129+0000 7f68927fc640 1 -- 172.21.15.87:0/51972734 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f6894058600 con 0x7f689c140100 2024-05-09T07:54:50.145 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:50.145 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":21,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:38.084989+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:50.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f688006be60 msgr2=0x7f688006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.146 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f688006be60 0x7f688006e320 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6898007d20 tx=0x7f6898009040 comp rx=0 tx=0).stop 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f689c140100 msgr2=0x7f689c1431d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f689c140100 0x7f689c1431d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f689c0b06e0 tx=0x7f689400fd60 comp rx=0 tx=0).stop 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 shutdown_connections 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f688006be60 0x7f688006e320 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f689c140100 0x7f689c1431d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f689c1dcb50 0x7f689c13fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 --2- 172.21.15.87:0/51972734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68880040d0 0x7f689c1e0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 >> 172.21.15.87:0/51972734 conn(0x7f689c0b68e0 msgr2=0x7f689c147f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 shutdown_connections 2024-05-09T07:54:50.147 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.131+0000 7f68a3f16640 1 -- 172.21.15.87:0/51972734 wait complete. 2024-05-09T07:54:50.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T07:54:24.920922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T07:54:34.879628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T07:54:35.405648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T07:54:50.158 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T07:54:50.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.244+0000 7f7111415640 1 Processor -- start 2024-05-09T07:54:50.259 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.244+0000 7f7111415640 1 -- start start 2024-05-09T07:54:50.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7111415640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f710c06e7e0 0x7f710c0b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7111415640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c073140 0x7f710c073580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7111415640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c13fe80 con 0x7f710c145990 2024-05-09T07:54:50.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7111415640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f710c06ebc0 con 0x7f710c06e7e0 2024-05-09T07:54:50.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7111415640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f710c0b6df0 con 0x7f710c073140 2024-05-09T07:54:50.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f710b7fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f710c145990 0x7f710c145df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43738/0 (socket says 172.21.15.87:43738) 2024-05-09T07:54:50.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f710b7fe640 1 -- 172.21.15.87:0/4156147154 learned_addr learned my addr 172.21.15.87:0/4156147154 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:50.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f710affd640 1 --2- 172.21.15.87:0/4156147154 >> v2:172.21.15.110:3300/0 conn(0x7f710c06e7e0 0x7f710c0b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f710a7fc640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c073140 0x7f710c073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504261573 0 0) 0x7f710c13fe80 con 0x7f710c145990 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70f4003520 con 0x7f710c145990 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1032206214 0 0) 0x7f70f4003520 con 0x7f710c145990 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c073140 msgr2=0x7f710c073580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7109ffb640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c073140 0x7f710c073580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 >> v2:172.21.15.110:3300/0 conn(0x7f710c06e7e0 msgr2=0x7f710c0b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7109ffb640 1 --2- 172.21.15.87:0/4156147154 >> v2:172.21.15.110:3300/0 conn(0x7f710c06e7e0 0x7f710c0b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.245+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c0b70d0 con 0x7f710c145990 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f71040019f0 con 0x7f710c145990 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 >> v1:172.21.15.87:6789/0 conn(0x7f710c145990 legacy=0x7f710c145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f7109ffb640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f40039b0 0x7f70f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f7109ffb640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f70f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f7109ffb640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c073140 0x7f70f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.264 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f710c06ebc0 con 0x7f70f4004800 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0b6df0 con 0x7f70f40039b0 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f70f400b9c0 con 0x7f710c073140 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f710a7fc640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f70f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f710affd640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f40039b0 0x7f70f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f710b7fe640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c073140 0x7f70f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f710a7fc640 1 -- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c073140 msgr2=0x7f70f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f710a7fc640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c073140 0x7f70f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f710a7fc640 1 -- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f40039b0 msgr2=0x7f70f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f710a7fc640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f40039b0 0x7f70f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.246+0000 7f710a7fc640 1 -- 172.21.15.87:0/4156147154 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f4003520 con 0x7f70f4004800 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f710a7fc640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f70f4004c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7100009ac0 tx=0x7f70f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e26e4fc9e78998 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100036070 con 0x7f70f4004800 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7100031400 con 0x7f70f4004800 2024-05-09T07:54:50.265 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f7109ffb640 1 -- 172.21.15.87:0/4156147154 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100009690 con 0x7f70f4004800 2024-05-09T07:54:50.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f7111415640 1 -- 172.21.15.87:0/4156147154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 msgr2=0x7f70f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f7111415640 1 --2- 172.21.15.87:0/4156147154 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f70f4004c80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7100009ac0 tx=0x7f70f4005830 comp rx=0 tx=0).stop 2024-05-09T07:54:50.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f710b7fe640 1 -- 172.21.15.87:0/4156147154 reap_dead start 2024-05-09T07:54:50.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f7111415640 1 -- 172.21.15.87:0/4156147154 shutdown_connections 2024-05-09T07:54:50.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f7111415640 1 -- 172.21.15.87:0/4156147154 >> 172.21.15.87:0/4156147154 conn(0x7f710c0baf40 msgr2=0x7f710c0bb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:50.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f7111415640 1 -- 172.21.15.87:0/4156147154 shutdown_connections 2024-05-09T07:54:50.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.247+0000 7f7111415640 1 -- 172.21.15.87:0/4156147154 wait complete. 2024-05-09T07:54:50.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f7111415640 1 Processor -- start 2024-05-09T07:54:50.266 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f7111415640 1 -- start start 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f7111415640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f710c1de3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f7111415640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f710c0b4ef0 0x7f710c13aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f7111415640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c13b410 0x7f710c0b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f7111415640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0b0640 con 0x7f70f4004800 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f7111415640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0b7690 con 0x7f710c0b4ef0 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f7111415640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f710c0aff60 con 0x7f710c13b410 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f710c1de3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f710c1de3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56054/0 (socket says 172.21.15.87:56054) 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710affd640 1 -- 172.21.15.87:0/2932859418 learned_addr learned my addr 172.21.15.87:0/2932859418 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710b7fe640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c13b410 0x7f710c0b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710a7fc640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f710c0b4ef0 0x7f710c13aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710affd640 1 -- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c13b410 msgr2=0x7f710c0b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.269 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710affd640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c13b410 0x7f710c0b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710affd640 1 -- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f710c0b4ef0 msgr2=0x7f710c13aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710affd640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f710c0b4ef0 0x7f710c13aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710affd640 1 -- 172.21.15.87:0/2932859418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c142e60 con 0x7f70f4004800 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710b7fe640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c13b410 0x7f710c0b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.249+0000 7f710a7fc640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f710c0b4ef0 0x7f710c13aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.250+0000 7f710affd640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f710c1de3b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f70fc011a70 tx=0x7f70fc011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.250+0000 7f70f37fe640 1 -- 172.21.15.87:0/2932859418 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00fb50 con 0x7f70f4004800 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.250+0000 7f70f37fe640 1 -- 172.21.15.87:0/2932859418 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70fc00fcf0 con 0x7f70f4004800 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.250+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c1deb40 con 0x7f70f4004800 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.250+0000 7f70f37fe640 1 -- 172.21.15.87:0/2932859418 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00fea0 con 0x7f70f4004800 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.250+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c0b3ad0 con 0x7f70f4004800 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.251+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c1df060 con 0x7f70f4004800 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.251+0000 7f70f37fe640 1 -- 172.21.15.87:0/2932859418 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70fc012040 con 0x7f70f4004800 2024-05-09T07:54:50.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.252+0000 7f70f37fe640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f70f806be30 0x7f70f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.252+0000 7f710a7fc640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f70f806be30 0x7f70f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.252+0000 7f70f37fe640 1 -- 172.21.15.87:0/2932859418 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f70fc08b4f0 con 0x7f70f4004800 2024-05-09T07:54:50.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.252+0000 7f710a7fc640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f70f806be30 0x7f70f806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7100033000 tx=0x7f7100008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:50.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.256+0000 7f70f37fe640 1 -- 172.21.15.87:0/2932859418 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f70fc019030 con 0x7f70f4004800 2024-05-09T07:54:50.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.426+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f710c0b2890 con 0x7f70f4004800 2024-05-09T07:54:50.441 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.427+0000 7f70f37fe640 1 -- 172.21.15.87:0/2932859418 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f70fc059f30 con 0x7f70f4004800 2024-05-09T07:54:50.441 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-09T07:54:50.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f70f806be30 msgr2=0x7f70f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.443 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f70f806be30 0x7f70f806e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7100033000 tx=0x7f7100008030 comp rx=0 tx=0).stop 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 msgr2=0x7f710c1de3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f710c1de3b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f70fc011a70 tx=0x7f70fc011f30 comp rx=0 tx=0).stop 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 shutdown_connections 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f70f806be30 0x7f70f806e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f710c13b410 0x7f710c0b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f710c0b4ef0 0x7f710c13aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 --2- 172.21.15.87:0/2932859418 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f70f4004800 0x7f710c1de3b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 >> 172.21.15.87:0/2932859418 conn(0x7f710c0baf40 msgr2=0x7f710c143650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 shutdown_connections 2024-05-09T07:54:50.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.429+0000 7f7111415640 1 -- 172.21.15.87:0/2932859418 wait complete. 2024-05-09T07:54:50.454 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T07:54:50.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.543+0000 7ffb73963640 1 Processor -- start 2024-05-09T07:54:50.558 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.543+0000 7ffb73963640 1 -- start start 2024-05-09T07:54:50.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.544+0000 7ffb73963640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 0x7ffb6c0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.544+0000 7ffb73963640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb6c141ec0 0x7ffb6c147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.544+0000 7ffb73963640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c0b4780 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.544+0000 7ffb73963640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7ffb6c0b6090 con 0x7ffb6c141ec0 2024-05-09T07:54:50.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.544+0000 7ffb73963640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6c0b6370 con 0x7ffb6c0b4dd0 2024-05-09T07:54:50.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.544+0000 7ffb71f00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb6c141ec0 0x7ffb6c147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.544+0000 7ffb71f00640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffb6c141ec0 0x7ffb6c147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56062/0 (socket says 172.21.15.87:56062) 2024-05-09T07:54:50.560 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.544+0000 7ffb71f00640 1 -- 172.21.15.87:0/2055515816 learned_addr learned my addr 172.21.15.87:0/2055515816 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:50.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.544+0000 7ffb716ff640 1 --2- 172.21.15.87:0/2055515816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 0x7ffb6c0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.545+0000 7ffb71f00640 1 -- 172.21.15.87:0/2055515816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 msgr2=0x7ffb6c0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:50.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.545+0000 7ffb71f00640 1 --2- 172.21.15.87:0/2055515816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 0x7ffb6c0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.545+0000 7ffb71f00640 1 -- 172.21.15.87:0/2055515816 >> v1:172.21.15.110:6789/0 conn(0x7ffb6c0b56f0 legacy=0x7ffb6c1417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.545+0000 7ffb71f00640 1 -- 172.21.15.87:0/2055515816 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c0b5e20 con 0x7ffb6c141ec0 2024-05-09T07:54:50.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.545+0000 7ffb71f00640 1 --2- 172.21.15.87:0/2055515816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c141ec0 0x7ffb6c147cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009e80 tx=0x7ffb6402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d89ce0d2e589a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:50.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.545+0000 7ffb63fff640 1 -- 172.21.15.87:0/2055515816 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64036070 con 0x7ffb6c141ec0 2024-05-09T07:54:50.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb63fff640 1 -- 172.21.15.87:0/2055515816 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb64031600 con 0x7ffb6c141ec0 2024-05-09T07:54:50.561 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb63fff640 1 -- 172.21.15.87:0/2055515816 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb640319d0 con 0x7ffb6c141ec0 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb73963640 1 -- 172.21.15.87:0/2055515816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c141ec0 msgr2=0x7ffb6c147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb73963640 1 --2- 172.21.15.87:0/2055515816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c141ec0 0x7ffb6c147cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009e80 tx=0x7ffb6402a6c0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb73963640 1 -- 172.21.15.87:0/2055515816 shutdown_connections 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb73963640 1 --2- 172.21.15.87:0/2055515816 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c141ec0 0x7ffb6c147cf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb73963640 1 --2- 172.21.15.87:0/2055515816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 0x7ffb6c0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb73963640 1 -- 172.21.15.87:0/2055515816 >> 172.21.15.87:0/2055515816 conn(0x7ffb6c0677b0 msgr2=0x7ffb6c0bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb73963640 1 -- 172.21.15.87:0/2055515816 shutdown_connections 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.546+0000 7ffb73963640 1 -- 172.21.15.87:0/2055515816 wait complete. 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.547+0000 7ffb73963640 1 Processor -- start 2024-05-09T07:54:50.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.547+0000 7ffb73963640 1 -- start start 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb73963640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 0x7ffb6c13b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb73963640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0b56f0 0x7ffb6c1e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb73963640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb6c141ec0 0x7ffb6c143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb73963640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c1483b0 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb73963640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c148230 con 0x7ffb6c141ec0 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb73963640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6c148530 con 0x7ffb6c0b4dd0 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb70efe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0b56f0 0x7ffb6c1e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb70efe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0b56f0 0x7ffb6c1e0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56078/0 (socket says 172.21.15.87:56078) 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb70efe640 1 -- 172.21.15.87:0/1867480598 learned_addr learned my addr 172.21.15.87:0/1867480598 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb716ff640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 0x7ffb6c13b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb71f00640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb6c141ec0 0x7ffb6c143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb70efe640 1 -- 172.21.15.87:0/1867480598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 msgr2=0x7ffb6c13b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb70efe640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 0x7ffb6c13b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb70efe640 1 -- 172.21.15.87:0/1867480598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb6c141ec0 msgr2=0x7ffb6c143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb70efe640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb6c141ec0 0x7ffb6c143e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb70efe640 1 -- 172.21.15.87:0/1867480598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c1426a0 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb70efe640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0b56f0 0x7ffb6c1e0bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00c430 tx=0x7ffb5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:50.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb61ffb640 1 -- 172.21.15.87:0/1867480598 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0052d0 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb61ffb640 1 -- 172.21.15.87:0/1867480598 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c005490 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c1451a0 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.548+0000 7ffb61ffb640 1 -- 172.21.15.87:0/1867480598 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c007260 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.549+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6c14b850 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.550+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6c0691f0 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.550+0000 7ffb61ffb640 1 -- 172.21.15.87:0/1867480598 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb5c007400 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.551+0000 7ffb61ffb640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb5006be30 0x7ffb5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.551+0000 7ffb716ff640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb5006be30 0x7ffb5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.551+0000 7ffb61ffb640 1 -- 172.21.15.87:0/1867480598 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffb5c08a240 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.551+0000 7ffb716ff640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb5006be30 0x7ffb5006e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009b40 tx=0x7ffb68009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:50.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.555+0000 7ffb61ffb640 1 -- 172.21.15.87:0/1867480598 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffb5c058630 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.728+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffb6c13edd0 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.728+0000 7ffb61ffb640 1 -- 172.21.15.87:0/1867480598 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7ffb5c05c930 con 0x7ffb6c0b56f0 2024-05-09T07:54:50.743 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-05-09T07:54:50.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb5006be30 msgr2=0x7ffb5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb5006be30 0x7ffb5006e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009b40 tx=0x7ffb68009190 comp rx=0 tx=0).stop 2024-05-09T07:54:50.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0b56f0 msgr2=0x7ffb6c1e0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0b56f0 0x7ffb6c1e0bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00c430 tx=0x7ffb5c00c8f0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 shutdown_connections 2024-05-09T07:54:50.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb5006be30 0x7ffb5006e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb6c141ec0 0x7ffb6c143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb6c0b56f0 0x7ffb6c1e0bc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 --2- 172.21.15.87:0/1867480598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb6c0b4dd0 0x7ffb6c13b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 >> 172.21.15.87:0/1867480598 conn(0x7ffb6c0677b0 msgr2=0x7ffb6c145d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:50.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 shutdown_connections 2024-05-09T07:54:50.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.730+0000 7ffb73963640 1 -- 172.21.15.87:0/1867480598 wait complete. 2024-05-09T07:54:50.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T07:54:50.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.843+0000 7f581b909640 1 Processor -- start 2024-05-09T07:54:50.858 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.843+0000 7f581b909640 1 -- start start 2024-05-09T07:54:50.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f581b909640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58140b8120 0x7f5814141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f581b909640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5814141ab0 0x7f581406d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f581b909640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58140b8500 con 0x7f581406ddd0 2024-05-09T07:54:50.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f581b909640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f58140b6240 con 0x7f58140b8120 2024-05-09T07:54:50.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f581b909640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f581406d090 con 0x7f5814141ab0 2024-05-09T07:54:50.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f5819ea6640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f581406ddd0 0x7f5814071680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:43750/0 (socket says 172.21.15.87:43750) 2024-05-09T07:54:50.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f5819ea6640 1 -- 172.21.15.87:0/3256623104 learned_addr learned my addr 172.21.15.87:0/3256623104 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:50.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f5818ea4640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5814141ab0 0x7f581406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.862 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f58196a5640 1 --2- 172.21.15.87:0/3256623104 >> v2:172.21.15.110:3300/0 conn(0x7f58140b8120 0x7f5814141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479226334 0 0) 0x7f58140b8500 con 0x7f581406ddd0 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.844+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57fc003520 con 0x7f581406ddd0 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2781811951 0 0) 0x7f57fc003520 con 0x7f581406ddd0 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5814141ab0 msgr2=0x7f581406d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5814141ab0 0x7f581406d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 >> v2:172.21.15.110:3300/0 conn(0x7f58140b8120 msgr2=0x7f5814141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 --2- 172.21.15.87:0/3256623104 >> v2:172.21.15.110:3300/0 conn(0x7f58140b8120 0x7f5814141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581406e220 con 0x7f581406ddd0 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f580c001670 con 0x7f581406ddd0 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 >> v1:172.21.15.87:6789/0 conn(0x7f581406ddd0 legacy=0x7f5814071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57fc0039e0 0x7f57fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5814141ab0 0x7f57fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f57fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.863 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f581406d090 con 0x7f57fc004d40 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc00b9f0 con 0x7f57fc0039e0 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f57fc00bbf0 con 0x7f5814141ab0 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5819ea6640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f57fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f58196a5640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57fc0039e0 0x7f57fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5818ea4640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5814141ab0 0x7f57fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5819ea6640 1 -- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5814141ab0 msgr2=0x7f57fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5819ea6640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5814141ab0 0x7f57fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5819ea6640 1 -- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57fc0039e0 msgr2=0x7f57fc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5819ea6640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57fc0039e0 0x7f57fc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5819ea6640 1 -- 172.21.15.87:0/3256623104 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc003520 con 0x7f57fc004d40 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.845+0000 7f5818ea4640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5814141ab0 0x7f57fc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f5819ea6640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f57fc0051c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c210 tx=0x7f57fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6226ea77c93c99f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c007d30 con 0x7f57fc004d40 2024-05-09T07:54:50.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c005af0 con 0x7f57fc004d40 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f5813fff640 1 -- 172.21.15.87:0/3256623104 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c007070 con 0x7f57fc004d40 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f581b909640 1 -- 172.21.15.87:0/3256623104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 msgr2=0x7f57fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f581b909640 1 --2- 172.21.15.87:0/3256623104 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f57fc0051c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c210 tx=0x7f57fc005830 comp rx=0 tx=0).stop 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f5819ea6640 1 -- 172.21.15.87:0/3256623104 reap_dead start 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f581b909640 1 -- 172.21.15.87:0/3256623104 shutdown_connections 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f581b909640 1 -- 172.21.15.87:0/3256623104 >> 172.21.15.87:0/3256623104 conn(0x7f581406b610 msgr2=0x7f581406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f581b909640 1 -- 172.21.15.87:0/3256623104 shutdown_connections 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.846+0000 7f581b909640 1 -- 172.21.15.87:0/3256623104 wait complete. 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.847+0000 7f581b909640 1 Processor -- start 2024-05-09T07:54:50.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.847+0000 7f581b909640 1 -- start start 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f581b909640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f581413dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f581b909640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f581413e1e0 0x7f58140ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f581b909640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58140ae3c0 0x7f5814142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f581b909640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f58140b5bf0 con 0x7f57fc004d40 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f581b909640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5814141ef0 con 0x7f58140ae3c0 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f581b909640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f58140b5ed0 con 0x7f581413e1e0 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f58196a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f581413dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f58196a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f581413dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56094/0 (socket says 172.21.15.87:56094) 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f58196a5640 1 -- 172.21.15.87:0/1744662417 learned_addr learned my addr 172.21.15.87:0/1744662417 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f5819ea6640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58140ae3c0 0x7f5814142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f5818ea4640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f581413e1e0 0x7f58140ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f58196a5640 1 -- 172.21.15.87:0/1744662417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f581413e1e0 msgr2=0x7f58140ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f58196a5640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f581413e1e0 0x7f58140ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f58196a5640 1 -- 172.21.15.87:0/1744662417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58140ae3c0 msgr2=0x7f5814142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f58196a5640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58140ae3c0 0x7f5814142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f58196a5640 1 -- 172.21.15.87:0/1744662417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58141e0c50 con 0x7f57fc004d40 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f5819ea6640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58140ae3c0 0x7f5814142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.848+0000 7f58196a5640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f581413dca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5804009f90 tx=0x7f580400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.849+0000 7f5811ffb640 1 -- 172.21.15.87:0/1744662417 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580400fea0 con 0x7f57fc004d40 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.849+0000 7f5811ffb640 1 -- 172.21.15.87:0/1744662417 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5804015630 con 0x7f57fc004d40 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.849+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58141e0f30 con 0x7f57fc004d40 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.849+0000 7f5811ffb640 1 -- 172.21.15.87:0/1744662417 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804015a20 con 0x7f57fc004d40 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.849+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58140af620 con 0x7f57fc004d40 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.850+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58140691f0 con 0x7f57fc004d40 2024-05-09T07:54:50.869 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.850+0000 7f5811ffb640 1 -- 172.21.15.87:0/1744662417 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5804015bc0 con 0x7f57fc004d40 2024-05-09T07:54:50.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.851+0000 7f5811ffb640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f580006be60 0x7f580006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:50.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.851+0000 7f5811ffb640 1 -- 172.21.15.87:0/1744662417 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f580408bfe0 con 0x7f57fc004d40 2024-05-09T07:54:50.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.851+0000 7f5818ea4640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f580006be60 0x7f580006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:50.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.851+0000 7f5818ea4640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f580006be60 0x7f580006e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f58140b51c0 tx=0x7f5808008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:50.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:50.855+0000 7f5811ffb640 1 -- 172.21.15.87:0/1744662417 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5804019030 con 0x7f57fc004d40 2024-05-09T07:54:51.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.030+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f581406cad0 con 0x7f57fc004d40 2024-05-09T07:54:51.044 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.030+0000 7f5811ffb640 1 -- 172.21.15.87:0/1744662417 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f5804010040 con 0x7f57fc004d40 2024-05-09T07:54:51.045 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f580006be60 msgr2=0x7f580006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f580006be60 0x7f580006e320 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f58140b51c0 tx=0x7f5808008040 comp rx=0 tx=0).stop 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 msgr2=0x7f581413dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f581413dca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5804009f90 tx=0x7f580400f580 comp rx=0 tx=0).stop 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 shutdown_connections 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f580006be60 0x7f580006e320 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f581413e1e0 0x7f58140ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58140ae3c0 0x7f5814142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 --2- 172.21.15.87:0/1744662417 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57fc004d40 0x7f581413dca0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 >> 172.21.15.87:0/1744662417 conn(0x7f581406b610 msgr2=0x7f58140b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:51.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 shutdown_connections 2024-05-09T07:54:51.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.032+0000 7f581b909640 1 -- 172.21.15.87:0/1744662417 wait complete. 2024-05-09T07:54:51.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T07:54:51.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.141+0000 7fedbfc6b640 1 Processor -- start 2024-05-09T07:54:51.156 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.141+0000 7fedbfc6b640 1 -- start start 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.142+0000 7fedbfc6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb8147720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.142+0000 7fedbfc6b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedb80b3e30 0x7fedb8141580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.142+0000 7fedbfc6b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb80b5900 con 0x7fedb8141ac0 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.142+0000 7fedbfc6b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fedb80b50c0 con 0x7fedb80b3e30 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.142+0000 7fedbfc6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fedb80b4a70 con 0x7fedb80b5e20 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.142+0000 7fedbd206640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedb80b3e30 0x7fedb8141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.142+0000 7fedbd206640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedb80b3e30 0x7fedb8141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56106/0 (socket says 172.21.15.87:56106) 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.142+0000 7fedbd206640 1 -- 172.21.15.87:0/1974741181 learned_addr learned my addr 172.21.15.87:0/1974741181 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbda07640 1 --2- 172.21.15.87:0/1974741181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb8147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbd206640 1 -- 172.21.15.87:0/1974741181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 msgr2=0x7fedb8147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.159 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbd206640 1 --2- 172.21.15.87:0/1974741181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb8147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbd206640 1 -- 172.21.15.87:0/1974741181 >> v1:172.21.15.110:6789/0 conn(0x7fedb8141ac0 legacy=0x7fedb80b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbd206640 1 -- 172.21.15.87:0/1974741181 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb80b4d50 con 0x7fedb80b3e30 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbda07640 1 --2- 172.21.15.87:0/1974741181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb8147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbd206640 1 --2- 172.21.15.87:0/1974741181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 0x7fedb8141580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feda8009870 tx=0x7feda802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a17d1e31b64072 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbca05640 1 -- 172.21.15.87:0/1974741181 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8037070 con 0x7fedb80b3e30 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbca05640 1 -- 172.21.15.87:0/1974741181 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda8032440 con 0x7fedb80b3e30 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.143+0000 7fedbca05640 1 -- 172.21.15.87:0/1974741181 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8032810 con 0x7fedb80b3e30 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.144+0000 7fedbfc6b640 1 -- 172.21.15.87:0/1974741181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 msgr2=0x7fedb8141580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.144+0000 7fedbfc6b640 1 --2- 172.21.15.87:0/1974741181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 0x7fedb8141580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feda8009870 tx=0x7feda802a210 comp rx=0 tx=0).stop 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.144+0000 7fedbfc6b640 1 -- 172.21.15.87:0/1974741181 shutdown_connections 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.144+0000 7fedbfc6b640 1 --2- 172.21.15.87:0/1974741181 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 0x7fedb8141580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.144+0000 7fedbfc6b640 1 --2- 172.21.15.87:0/1974741181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb8147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.144+0000 7fedbfc6b640 1 -- 172.21.15.87:0/1974741181 >> 172.21.15.87:0/1974741181 conn(0x7fedb80676a0 msgr2=0x7fedb80bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:51.160 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.144+0000 7fedbfc6b640 1 -- 172.21.15.87:0/1974741181 shutdown_connections 2024-05-09T07:54:51.161 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.144+0000 7fedbfc6b640 1 -- 172.21.15.87:0/1974741181 wait complete. 2024-05-09T07:54:51.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.145+0000 7fedbfc6b640 1 Processor -- start 2024-05-09T07:54:51.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.145+0000 7fedbfc6b640 1 -- start start 2024-05-09T07:54:51.163 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbfc6b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 0x7fedb80bb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbfc6b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb81d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbfc6b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb8141ac0 0x7fedb813d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbfc6b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fedb80b5550 con 0x7fedb80b3e30 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbfc6b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fedb80bdbc0 con 0x7fedb8141ac0 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbfc6b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fedb814bad0 con 0x7fedb80b5e20 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbda07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 0x7fedb80bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbda07640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 0x7fedb80bb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:56110/0 (socket says 172.21.15.87:56110) 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbda07640 1 -- 172.21.15.87:0/3887148958 learned_addr learned my addr 172.21.15.87:0/3887148958 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbd206640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb81d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbe208640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb8141ac0 0x7fedb813d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbda07640 1 -- 172.21.15.87:0/3887148958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 msgr2=0x7fedb81d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbda07640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb81d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbda07640 1 -- 172.21.15.87:0/3887148958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb8141ac0 msgr2=0x7fedb813d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.164 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbda07640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb8141ac0 0x7fedb813d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbda07640 1 -- 172.21.15.87:0/3887148958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb81d4190 con 0x7fedb80b3e30 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbd206640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb81d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbda07640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 0x7fedb80bb900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fedb400a390 tx=0x7fedb400a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedae7fc640 1 -- 172.21.15.87:0/3887148958 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4019070 con 0x7fedb80b3e30 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedae7fc640 1 -- 172.21.15.87:0/3887148958 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb4008580 con 0x7fedb80b3e30 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb81d46f0 con 0x7fedb80b3e30 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedae7fc640 1 -- 172.21.15.87:0/3887148958 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4008950 con 0x7fedb80b3e30 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.146+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb81d4410 con 0x7fedb80b3e30 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.147+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb80691f0 con 0x7fedb80b3e30 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.148+0000 7fedae7fc640 1 -- 172.21.15.87:0/3887148958 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fedb401c070 con 0x7fedb80b3e30 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.148+0000 7fedae7fc640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fed9c06be30 0x7fed9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.148+0000 7fedae7fc640 1 -- 172.21.15.87:0/3887148958 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fedb408afa0 con 0x7fedb80b3e30 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.148+0000 7fedbd206640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fed9c06be30 0x7fed9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.165 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.149+0000 7fedbd206640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fed9c06be30 0x7fed9c06e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feda8034000 tx=0x7feda802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:51.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.152+0000 7fedae7fc640 1 -- 172.21.15.87:0/3887148958 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fedb81d4190 con 0x7fedb80b3e30 2024-05-09T07:54:51.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.361+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedb81d0ba0 con 0x7fedb80b3e30 2024-05-09T07:54:51.376 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.362+0000 7fedae7fc640 1 -- 172.21.15.87:0/3887148958 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7fedb4059390 con 0x7fedb80b3e30 2024-05-09T07:54:51.377 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:51.377 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/138437726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":138437726},{"type":"v1","addr":"172.21.15.110:6833","nonce":138437726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T07:54:36.428491+0000","modified":"2024-05-09T07:54:38.820976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2148825985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2148825985},{"type":"v1","addr":"172.21.15.87:6835","nonce":2148825985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-05-09T07:54:51.377 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fed9c06be30 msgr2=0x7fed9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fed9c06be30 0x7fed9c06e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feda8034000 tx=0x7feda802e000 comp rx=0 tx=0).stop 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 msgr2=0x7fedb80bb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 0x7fedb80bb900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fedb400a390 tx=0x7fedb400a850 comp rx=0 tx=0).stop 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 shutdown_connections 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fed9c06be30 0x7fed9c06e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedb80b5e20 0x7fedb81d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb8141ac0 0x7fedb813d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 --2- 172.21.15.87:0/3887148958 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedb80b3e30 0x7fedb80bb900 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 >> 172.21.15.87:0/3887148958 conn(0x7fedb80676a0 msgr2=0x7fedb80b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 shutdown_connections 2024-05-09T07:54:51.379 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.364+0000 7fedbfc6b640 1 -- 172.21.15.87:0/3887148958 wait complete. 2024-05-09T07:54:51.390 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:51.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.474+0000 7fdb3b4df640 1 Processor -- start 2024-05-09T07:54:51.489 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.474+0000 7fdb3b4df640 1 -- start start 2024-05-09T07:54:51.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb3b4df640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdb340b3e30 0x7fdb34141580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb3b4df640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb34141ac0 0x7fdb34152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb3b4df640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb34147e30 con 0x7fdb340b5e20 2024-05-09T07:54:51.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb3b4df640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fdb340b50c0 con 0x7fdb340b3e30 2024-05-09T07:54:51.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb3b4df640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fdb340b5900 con 0x7fdb34141ac0 2024-05-09T07:54:51.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb3927b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdb340b5e20 0x7fdb34147720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41388/0 (socket says 172.21.15.87:41388) 2024-05-09T07:54:51.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb3927b640 1 -- 172.21.15.87:0/1743905609 learned_addr learned my addr 172.21.15.87:0/1743905609 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:51.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb39a7c640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb34141ac0 0x7fdb34152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.493 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb38a7a640 1 --2- 172.21.15.87:0/1743905609 >> v2:172.21.15.110:3300/0 conn(0x7fdb340b3e30 0x7fdb34141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4269549005 0 0) 0x7fdb34147e30 con 0x7fdb340b5e20 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.475+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb20003520 con 0x7fdb340b5e20 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2609476392 0 0) 0x7fdb20003520 con 0x7fdb340b5e20 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb34141ac0 msgr2=0x7fdb34152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb34141ac0 0x7fdb34152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 >> v2:172.21.15.110:3300/0 conn(0x7fdb340b3e30 msgr2=0x7fdb34141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 --2- 172.21.15.87:0/1743905609 >> v2:172.21.15.110:3300/0 conn(0x7fdb340b3e30 0x7fdb34141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb340b4a70 con 0x7fdb340b5e20 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7fdb30001b70 con 0x7fdb340b5e20 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb39a7c640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb34141ac0 0x7fdb34152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 >> v1:172.21.15.87:6789/0 conn(0x7fdb340b5e20 legacy=0x7fdb34147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb34141ac0 0x7fdb200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb20003ef0 0x7fdb20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20004d40 0x7fdb200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdb340b50c0 con 0x7fdb20003ef0 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdb340b5900 con 0x7fdb20004d40 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2000b9c0 con 0x7fdb34141ac0 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb38a7a640 1 --2- 172.21.15.87:0/1743905609 >> v2:172.21.15.110:3300/0 conn(0x7fdb340b3e30 0x7fdb34141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb38a7a640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb20003ef0 0x7fdb20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb3927b640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb34141ac0 0x7fdb200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb39a7c640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20004d40 0x7fdb200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb38a7a640 1 -- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb34141ac0 msgr2=0x7fdb200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb38a7a640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb34141ac0 0x7fdb200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb38a7a640 1 -- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20004d40 msgr2=0x7fdb200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb38a7a640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20004d40 0x7fdb200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb38a7a640 1 -- 172.21.15.87:0/1743905609 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb20003520 con 0x7fdb20003ef0 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.476+0000 7fdb39a7c640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20004d40 0x7fdb200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:51.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.477+0000 7fdb38a7a640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb20003ef0 0x7fdb20004800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009c40 tx=0x7fdb20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6212d736fd9507be server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.477+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24009840 con 0x7fdb20003ef0 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.477+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb24004020 con 0x7fdb20003ef0 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.477+0000 7fdb2bfff640 1 -- 172.21.15.87:0/1743905609 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb240043d0 con 0x7fdb20003ef0 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.477+0000 7fdb3b4df640 1 -- 172.21.15.87:0/1743905609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb20003ef0 msgr2=0x7fdb20004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.477+0000 7fdb3b4df640 1 --2- 172.21.15.87:0/1743905609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb20003ef0 0x7fdb20004800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009c40 tx=0x7fdb20005830 comp rx=0 tx=0).stop 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.477+0000 7fdb39a7c640 1 -- 172.21.15.87:0/1743905609 reap_dead start 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.477+0000 7fdb3b4df640 1 -- 172.21.15.87:0/1743905609 shutdown_connections 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.478+0000 7fdb3b4df640 1 -- 172.21.15.87:0/1743905609 >> 172.21.15.87:0/1743905609 conn(0x7fdb340676a0 msgr2=0x7fdb340bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.478+0000 7fdb3b4df640 1 -- 172.21.15.87:0/1743905609 shutdown_connections 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.478+0000 7fdb3b4df640 1 -- 172.21.15.87:0/1743905609 wait complete. 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb3b4df640 1 Processor -- start 2024-05-09T07:54:51.496 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb3b4df640 1 -- start start 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb3b4df640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20003ef0 0x7fdb3413add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb3b4df640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb341dd230 0x7fdb341dd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb3b4df640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb341381c0 0x7fdb34138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb3b4df640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdb340b5550 con 0x7fdb341dd230 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb3b4df640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdb340b6200 con 0x7fdb20003ef0 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb3b4df640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3414b900 con 0x7fdb341381c0 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb38a7a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb341dd230 0x7fdb341dd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb38a7a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb341dd230 0x7fdb341dd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60472/0 (socket says 172.21.15.87:60472) 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb38a7a640 1 -- 172.21.15.87:0/2694044211 learned_addr learned my addr 172.21.15.87:0/2694044211 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb3927b640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20003ef0 0x7fdb3413add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.479+0000 7fdb39a7c640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb341381c0 0x7fdb34138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb38a7a640 1 -- 172.21.15.87:0/2694044211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb341381c0 msgr2=0x7fdb34138640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.499 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb38a7a640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb341381c0 0x7fdb34138640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb38a7a640 1 -- 172.21.15.87:0/2694044211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20003ef0 msgr2=0x7fdb3413add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb38a7a640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20003ef0 0x7fdb3413add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb38a7a640 1 -- 172.21.15.87:0/2694044211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3413a780 con 0x7fdb341dd230 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb38a7a640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb341dd230 0x7fdb341dd6b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb2402ad40 tx=0x7fdb24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb29ffb640 1 -- 172.21.15.87:0/2694044211 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24040070 con 0x7fdb341dd230 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb29ffb640 1 -- 172.21.15.87:0/2694044211 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb24003820 con 0x7fdb341dd230 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb341ddbf0 con 0x7fdb341dd230 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb29ffb640 1 -- 172.21.15.87:0/2694044211 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24006e10 con 0x7fdb341dd230 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.480+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb34138b80 con 0x7fdb341dd230 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.481+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb3414b590 con 0x7fdb341dd230 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.482+0000 7fdb29ffb640 1 -- 172.21.15.87:0/2694044211 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb24043070 con 0x7fdb341dd230 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.482+0000 7fdb29ffb640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdb1806be30 0x7fdb1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.482+0000 7fdb29ffb640 1 -- 172.21.15.87:0/2694044211 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdb240ab5b0 con 0x7fdb341dd230 2024-05-09T07:54:51.500 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.482+0000 7fdb3927b640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdb1806be30 0x7fdb1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.483+0000 7fdb3927b640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdb1806be30 0x7fdb1806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb30001270 tx=0x7fdb30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:51.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.486+0000 7fdb29ffb640 1 -- 172.21.15.87:0/2694044211 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdb341ddbf0 con 0x7fdb341dd230 2024-05-09T07:54:51.674 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.660+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb340691f0 con 0x7fdb341dd230 2024-05-09T07:54:51.675 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.661+0000 7fdb29ffb640 1 -- 172.21.15.87:0/2694044211 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7fdb240799a0 con 0x7fdb341dd230 2024-05-09T07:54:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:51.676 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":21,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:38.084989+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:51.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdb1806be30 msgr2=0x7fdb1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdb1806be30 0x7fdb1806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb30001270 tx=0x7fdb30009040 comp rx=0 tx=0).stop 2024-05-09T07:54:51.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb341dd230 msgr2=0x7fdb341dd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb341dd230 0x7fdb341dd6b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdb2402ad40 tx=0x7fdb24004730 comp rx=0 tx=0).stop 2024-05-09T07:54:51.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 shutdown_connections 2024-05-09T07:54:51.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdb1806be30 0x7fdb1806e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb341381c0 0x7fdb34138640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb341dd230 0x7fdb341dd6b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.678 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 --2- 172.21.15.87:0/2694044211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb20003ef0 0x7fdb3413add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 >> 172.21.15.87:0/2694044211 conn(0x7fdb340676a0 msgr2=0x7fdb3413ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:51.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 shutdown_connections 2024-05-09T07:54:51.679 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.663+0000 7fdb3b4df640 1 -- 172.21.15.87:0/2694044211 wait complete. 2024-05-09T07:54:51.689 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T07:54:24.920922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T07:54:34.879628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T07:54:35.405648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T07:54:51.689 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T07:54:51.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.777+0000 7efeafed4640 1 Processor -- start 2024-05-09T07:54:51.792 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.778+0000 7efeafed4640 1 -- start start 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.778+0000 7efeafed4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea80b4dd0 0x7efea80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.778+0000 7efeafed4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efea80b56f0 0x7efea81417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.778+0000 7efeafed4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efea80b4780 con 0x7efea8141cf0 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.778+0000 7efeafed4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7efea8142180 con 0x7efea80b56f0 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.778+0000 7efeafed4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7efea80b6090 con 0x7efea80b4dd0 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.778+0000 7efeae471640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efea8141cf0 0x7efea8147cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41392/0 (socket says 172.21.15.87:41392) 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.778+0000 7efeae471640 1 -- 172.21.15.87:0/2283642772 learned_addr learned my addr 172.21.15.87:0/2283642772 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efead46f640 1 --2- 172.21.15.87:0/2283642772 >> v2:172.21.15.110:3300/0 conn(0x7efea80b56f0 0x7efea81417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeadc70640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea80b4dd0 0x7efea80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4079012536 0 0) 0x7efea80b4780 con 0x7efea8141cf0 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe94003520 con 0x7efea8141cf0 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 581231596 0 0) 0x7efe94003520 con 0x7efea8141cf0 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea80b4dd0 msgr2=0x7efea80b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea80b4dd0 0x7efea80b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 >> v2:172.21.15.110:3300/0 conn(0x7efea80b56f0 msgr2=0x7efea81417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 --2- 172.21.15.87:0/2283642772 >> v2:172.21.15.110:3300/0 conn(0x7efea80b56f0 0x7efea81417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea80b5e20 con 0x7efea8141cf0 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7efea00019f0 con 0x7efea8141cf0 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 >> v1:172.21.15.87:6789/0 conn(0x7efea8141cf0 legacy=0x7efea8147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe940039b0 0x7efe94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe94004800 0x7efe94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.797 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea80b4dd0 0x7efe940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efea80b6090 con 0x7efe94004800 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efe9400b9c0 con 0x7efe940039b0 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7efe9400bb40 con 0x7efea80b4dd0 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efead46f640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe94004800 0x7efe94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeadc70640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe940039b0 0x7efe94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efeae471640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea80b4dd0 0x7efe940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efead46f640 1 -- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea80b4dd0 msgr2=0x7efe940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efead46f640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efea80b4dd0 0x7efe940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efead46f640 1 -- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe940039b0 msgr2=0x7efe94003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efead46f640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe940039b0 0x7efe94003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.798 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.779+0000 7efead46f640 1 -- 172.21.15.87:0/2283642772 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe94003520 con 0x7efe94004800 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.780+0000 7efead46f640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe94004800 0x7efe94004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe98009af0 tx=0x7efe94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36878a869f11999c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.780+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98036070 con 0x7efe94004800 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.780+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe98031400 con 0x7efe94004800 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.780+0000 7efeacc6e640 1 -- 172.21.15.87:0/2283642772 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98009690 con 0x7efe94004800 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.781+0000 7efeafed4640 1 -- 172.21.15.87:0/2283642772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe94004800 msgr2=0x7efe94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.781+0000 7efeafed4640 1 --2- 172.21.15.87:0/2283642772 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe94004800 0x7efe94004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe98009af0 tx=0x7efe94005830 comp rx=0 tx=0).stop 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.781+0000 7efeae471640 1 -- 172.21.15.87:0/2283642772 reap_dead start 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.781+0000 7efeafed4640 1 -- 172.21.15.87:0/2283642772 shutdown_connections 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.781+0000 7efeafed4640 1 -- 172.21.15.87:0/2283642772 >> 172.21.15.87:0/2283642772 conn(0x7efea80677b0 msgr2=0x7efea80bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.781+0000 7efeafed4640 1 -- 172.21.15.87:0/2283642772 shutdown_connections 2024-05-09T07:54:51.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.781+0000 7efeafed4640 1 -- 172.21.15.87:0/2283642772 wait complete. 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.782+0000 7efeafed4640 1 Processor -- start 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.782+0000 7efeafed4640 1 -- start start 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.782+0000 7efeafed4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe94004800 0x7efea81cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeafed4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea8143340 0x7efea81437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeafed4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea81cfc10 0x7efea81d0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeafed4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efea80b4200 con 0x7efea81cfc10 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeafed4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efea80b4080 con 0x7efea8143340 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeafed4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7efea8148400 con 0x7efe94004800 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeae471640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea81cfc10 0x7efea81d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.802 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeae471640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea81cfc10 0x7efea81d0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60500/0 (socket says 172.21.15.87:60500) 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeae471640 1 -- 172.21.15.87:0/3206187762 learned_addr learned my addr 172.21.15.87:0/3206187762 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efead46f640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea8143340 0x7efea81437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeadc70640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe94004800 0x7efea81cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeae471640 1 -- 172.21.15.87:0/3206187762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe94004800 msgr2=0x7efea81cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeae471640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe94004800 0x7efea81cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeae471640 1 -- 172.21.15.87:0/3206187762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea8143340 msgr2=0x7efea81437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeae471640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea8143340 0x7efea81437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeae471640 1 -- 172.21.15.87:0/3206187762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea81cdee0 con 0x7efea81cfc10 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeadc70640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe94004800 0x7efea81cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeae471640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea81cfc10 0x7efea81d0090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efea80b3ac0 tx=0x7efea0007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efe9e7fc640 1 -- 172.21.15.87:0/3206187762 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0017020 con 0x7efea81cfc10 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efe9e7fc640 1 -- 172.21.15.87:0/3206187762 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea000abe0 con 0x7efea81cfc10 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea81d0720 con 0x7efea81cfc10 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efe9e7fc640 1 -- 172.21.15.87:0/3206187762 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00133f0 con 0x7efea81cfc10 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.783+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea81ce460 con 0x7efea81cfc10 2024-05-09T07:54:51.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.784+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea81450c0 con 0x7efea81cfc10 2024-05-09T07:54:51.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.785+0000 7efe9e7fc640 1 -- 172.21.15.87:0/3206187762 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efea001a020 con 0x7efea81cfc10 2024-05-09T07:54:51.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.785+0000 7efe9e7fc640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efe8c06be60 0x7efe8c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:51.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.785+0000 7efeadc70640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efe8c06be60 0x7efe8c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:51.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.785+0000 7efe9e7fc640 1 -- 172.21.15.87:0/3206187762 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efea008b4c0 con 0x7efea81cfc10 2024-05-09T07:54:51.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.785+0000 7efeadc70640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efe8c06be60 0x7efe8c06e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efea4009a60 tx=0x7efea4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:51.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.789+0000 7efe9e7fc640 1 -- 172.21.15.87:0/3206187762 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efea0021020 con 0x7efea81cfc10 2024-05-09T07:54:51.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.962+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efea80691f0 con 0x7efea81cfc10 2024-05-09T07:54:51.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.962+0000 7efe9e7fc640 1 -- 172.21.15.87:0/3206187762 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7efea0059f00 con 0x7efea81cfc10 2024-05-09T07:54:51.977 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-09T07:54:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efe8c06be60 msgr2=0x7efe8c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efe8c06be60 0x7efe8c06e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efea4009a60 tx=0x7efea4008040 comp rx=0 tx=0).stop 2024-05-09T07:54:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea81cfc10 msgr2=0x7efea81d0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea81cfc10 0x7efea81d0090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efea80b3ac0 tx=0x7efea0007bd0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 shutdown_connections 2024-05-09T07:54:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efe8c06be60 0x7efe8c06e320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efea81cfc10 0x7efea81d0090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efea8143340 0x7efea81437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 --2- 172.21.15.87:0/3206187762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe94004800 0x7efea81cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:51.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 >> 172.21.15.87:0/3206187762 conn(0x7efea80677b0 msgr2=0x7efea813e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:51.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 shutdown_connections 2024-05-09T07:54:51.980 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:51.964+0000 7efeafed4640 1 -- 172.21.15.87:0/3206187762 wait complete. 2024-05-09T07:54:51.990 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T07:54:52.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.077+0000 7f29c7038640 1 Processor -- start 2024-05-09T07:54:52.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.077+0000 7f29c7038640 1 -- start start 2024-05-09T07:54:52.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.078+0000 7f29c7038640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f29c006e7e0 0x7f29c00b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.078+0000 7f29c7038640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c0073140 0x7f29c0073580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.078+0000 7f29c7038640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c013fe80 con 0x7f29c0145990 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.078+0000 7f29c7038640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f29c006ebc0 con 0x7f29c006e7e0 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.078+0000 7f29c7038640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f29c00b6df0 con 0x7f29c0073140 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.078+0000 7f29bffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c0073140 0x7f29c0073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.078+0000 7f29c4dd4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f29c006e7e0 0x7f29c00b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.078+0000 7f29bffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c0073140 0x7f29c0073580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:50560/0 (socket says 172.21.15.87:50560) 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.078+0000 7f29bffff640 1 -- 172.21.15.87:0/4081031490 learned_addr learned my addr 172.21.15.87:0/4081031490 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.079+0000 7f29bffff640 1 -- 172.21.15.87:0/4081031490 >> v2:172.21.15.110:3300/0 conn(0x7f29c006e7e0 msgr2=0x7f29c00b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.079+0000 7f29bffff640 1 --2- 172.21.15.87:0/4081031490 >> v2:172.21.15.110:3300/0 conn(0x7f29c006e7e0 0x7f29c00b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.079+0000 7f29bffff640 1 -- 172.21.15.87:0/4081031490 >> v1:172.21.15.110:6789/0 conn(0x7f29c0145990 legacy=0x7f29c0145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.094 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.079+0000 7f29bffff640 1 -- 172.21.15.87:0/4081031490 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c00b70d0 con 0x7f29c0073140 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.079+0000 7f29bffff640 1 --2- 172.21.15.87:0/4081031490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c0073140 0x7f29c0073580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009e50 tx=0x7f29b402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c157def5da816a46 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29bf7fe640 1 -- 172.21.15.87:0/4081031490 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4036070 con 0x7f29c0073140 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29bf7fe640 1 -- 172.21.15.87:0/4081031490 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b4031600 con 0x7f29c0073140 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29bf7fe640 1 -- 172.21.15.87:0/4081031490 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b40319d0 con 0x7f29c0073140 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29c7038640 1 -- 172.21.15.87:0/4081031490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c0073140 msgr2=0x7f29c0073580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29c7038640 1 --2- 172.21.15.87:0/4081031490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c0073140 0x7f29c0073580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009e50 tx=0x7f29b402a710 comp rx=0 tx=0).stop 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29c7038640 1 -- 172.21.15.87:0/4081031490 shutdown_connections 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29c7038640 1 --2- 172.21.15.87:0/4081031490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c0073140 0x7f29c0073580 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29c7038640 1 --2- 172.21.15.87:0/4081031490 >> v2:172.21.15.110:3300/0 conn(0x7f29c006e7e0 0x7f29c00b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29c7038640 1 -- 172.21.15.87:0/4081031490 >> 172.21.15.87:0/4081031490 conn(0x7f29c00baf40 msgr2=0x7f29c00bb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29c7038640 1 -- 172.21.15.87:0/4081031490 shutdown_connections 2024-05-09T07:54:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.080+0000 7f29c7038640 1 -- 172.21.15.87:0/4081031490 wait complete. 2024-05-09T07:54:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.081+0000 7f29c7038640 1 Processor -- start 2024-05-09T07:54:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.081+0000 7f29c7038640 1 -- start start 2024-05-09T07:54:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c7038640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c006e7e0 0x7f29c00b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c7038640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c0073140 0x7f29c01de6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c7038640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c0145990 0x7f29c01debf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c7038640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f29c00b0640 con 0x7f29c0145990 2024-05-09T07:54:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c7038640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f29c00b7690 con 0x7f29c0073140 2024-05-09T07:54:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c7038640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f29c00aff60 con 0x7f29c006e7e0 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c55d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c0145990 0x7f29c01debf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c55d5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c0145990 0x7f29c01debf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60514/0 (socket says 172.21.15.87:60514) 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c55d5640 1 -- 172.21.15.87:0/1717646258 learned_addr learned my addr 172.21.15.87:0/1717646258 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29bffff640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c0073140 0x7f29c01de6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c4dd4640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c006e7e0 0x7f29c00b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c55d5640 1 -- 172.21.15.87:0/1717646258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c006e7e0 msgr2=0x7f29c00b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c55d5640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c006e7e0 0x7f29c00b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c55d5640 1 -- 172.21.15.87:0/1717646258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c0073140 msgr2=0x7f29c01de6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c55d5640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c0073140 0x7f29c01de6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c55d5640 1 -- 172.21.15.87:0/1717646258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c01db770 con 0x7f29c0145990 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.082+0000 7f29c55d5640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c0145990 0x7f29c01debf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c3f0 tx=0x7f29b800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.083+0000 7f29bd7fa640 1 -- 172.21.15.87:0/1717646258 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8017070 con 0x7f29c0145990 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.083+0000 7f29bd7fa640 1 -- 172.21.15.87:0/1717646258 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b80052d0 con 0x7f29c0145990 2024-05-09T07:54:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.083+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c01dba50 con 0x7f29c0145990 2024-05-09T07:54:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.083+0000 7f29bd7fa640 1 -- 172.21.15.87:0/1717646258 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8003830 con 0x7f29c0145990 2024-05-09T07:54:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.083+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c00b20d0 con 0x7f29c0145990 2024-05-09T07:54:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.084+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c00691f0 con 0x7f29c0145990 2024-05-09T07:54:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.084+0000 7f29bd7fa640 1 -- 172.21.15.87:0/1717646258 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29b801a070 con 0x7f29c0145990 2024-05-09T07:54:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.085+0000 7f29bd7fa640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f29ac06be30 0x7f29ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.085+0000 7f29c4dd4640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f29ac06be30 0x7f29ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.085+0000 7f29bd7fa640 1 -- 172.21.15.87:0/1717646258 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f29b8089fc0 con 0x7f29c0145990 2024-05-09T07:54:52.101 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.085+0000 7f29c4dd4640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f29ac06be30 0x7f29ac06e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009b40 tx=0x7f29b0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:52.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.089+0000 7f29bd7fa640 1 -- 172.21.15.87:0/1717646258 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f29b8058470 con 0x7f29c0145990 2024-05-09T07:54:52.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.270+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f29c01442d0 con 0x7f29c0145990 2024-05-09T07:54:52.285 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.270+0000 7f29bd7fa640 1 -- 172.21.15.87:0/1717646258 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f29b805c770 con 0x7f29c0145990 2024-05-09T07:54:52.285 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-05-09T07:54:52.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f29ac06be30 msgr2=0x7f29ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f29ac06be30 0x7f29ac06e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009b40 tx=0x7f29b0009190 comp rx=0 tx=0).stop 2024-05-09T07:54:52.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c0145990 msgr2=0x7f29c01debf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.287 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c0145990 0x7f29c01debf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29b800c3f0 tx=0x7f29b800c7f0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 shutdown_connections 2024-05-09T07:54:52.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f29ac06be30 0x7f29ac06e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f29c0145990 0x7f29c01debf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c0073140 0x7f29c01de6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 --2- 172.21.15.87:0/1717646258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c006e7e0 0x7f29c00b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 >> 172.21.15.87:0/1717646258 conn(0x7f29c00baf40 msgr2=0x7f29c00b80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:52.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 shutdown_connections 2024-05-09T07:54:52.288 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.272+0000 7f29c7038640 1 -- 172.21.15.87:0/1717646258 wait complete. 2024-05-09T07:54:52.298 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T07:54:52.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd5a0c3640 1 Processor -- start 2024-05-09T07:54:52.401 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd5a0c3640 1 -- start start 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd5a0c3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbd540b4260 0x7fbd54143f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd5a0c3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540af130 0x7fbd54144460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd5a0c3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd540b26e0 0x7fbd540b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd5a0c3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fbd540b4640 con 0x7fbd540b4260 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd5a0c3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fbd540b0ca0 con 0x7fbd540b26e0 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd5a0c3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbd540af610 con 0x7fbd540af130 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd537fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbd540b4260 0x7fbd54143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd537fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbd540b4260 0x7fbd54143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60526/0 (socket says 172.21.15.87:60526) 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.387+0000 7fbd537fe640 1 -- 172.21.15.87:0/3601121558 learned_addr learned my addr 172.21.15.87:0/3601121558 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:52.404 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.388+0000 7fbd53fff640 1 --2- 172.21.15.87:0/3601121558 >> v2:172.21.15.110:3300/0 conn(0x7fbd540b26e0 0x7fbd540b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.388+0000 7fbd537fe640 1 -- 172.21.15.87:0/3601121558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540af130 msgr2=0x7fbd54144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.388+0000 7fbd4affd640 1 --2- 172.21.15.87:0/3601121558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540af130 0x7fbd54144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.388+0000 7fbd537fe640 1 --2- 172.21.15.87:0/3601121558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540af130 0x7fbd54144460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.388+0000 7fbd537fe640 1 -- 172.21.15.87:0/3601121558 >> v2:172.21.15.110:3300/0 conn(0x7fbd540b26e0 msgr2=0x7fbd540b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.388+0000 7fbd537fe640 1 --2- 172.21.15.87:0/3601121558 >> v2:172.21.15.110:3300/0 conn(0x7fbd540b26e0 0x7fbd540b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.388+0000 7fbd537fe640 1 -- 172.21.15.87:0/3601121558 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd540af8f0 con 0x7fbd540b4260 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.388+0000 7fbd537fe640 1 --2- 172.21.15.87:0/3601121558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540b4260 0x7fbd54143f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd540b4fb0 tx=0x7fbd4402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d845edc6506daa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd52ffd640 1 -- 172.21.15.87:0/3601121558 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44037070 con 0x7fbd540b4260 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd52ffd640 1 -- 172.21.15.87:0/3601121558 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd44032440 con 0x7fbd540b4260 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd52ffd640 1 -- 172.21.15.87:0/3601121558 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44032810 con 0x7fbd540b4260 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/3601121558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540b4260 msgr2=0x7fbd54143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/3601121558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540b4260 0x7fbd54143f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbd540b4fb0 tx=0x7fbd4402a1e0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/3601121558 shutdown_connections 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/3601121558 >> v2:172.21.15.110:3300/0 conn(0x7fbd540b26e0 0x7fbd540b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.405 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/3601121558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540af130 0x7fbd54144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/3601121558 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540b4260 0x7fbd54143f20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/3601121558 >> 172.21.15.87:0/3601121558 conn(0x7fbd540b5860 msgr2=0x7fbd540b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:52.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/3601121558 shutdown_connections 2024-05-09T07:54:52.406 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.389+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/3601121558 wait complete. 2024-05-09T07:54:52.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.390+0000 7fbd5a0c3640 1 Processor -- start 2024-05-09T07:54:52.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.390+0000 7fbd5a0c3640 1 -- start start 2024-05-09T07:54:52.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd5a0c3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540af130 0x7fbd54134500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd5a0c3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd540b26e0 0x7fbd5413e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd5a0c3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540b4260 0x7fbd5413e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd5a0c3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540b0660 con 0x7fbd540af130 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd5a0c3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540b04e0 con 0x7fbd540b26e0 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd5a0c3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fbd540b3090 con 0x7fbd540b4260 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540af130 0x7fbd54134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd537fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540af130 0x7fbd54134500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60528/0 (socket says 172.21.15.87:60528) 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd537fe640 1 -- 172.21.15.87:0/2816845828 learned_addr learned my addr 172.21.15.87:0/2816845828 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd53fff640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540b4260 0x7fbd5413e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd4affd640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd540b26e0 0x7fbd5413e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd537fe640 1 -- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540b4260 msgr2=0x7fbd5413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd537fe640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540b4260 0x7fbd5413e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd537fe640 1 -- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd540b26e0 msgr2=0x7fbd5413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.410 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd537fe640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd540b26e0 0x7fbd5413e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd537fe640 1 -- 172.21.15.87:0/2816845828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd54141490 con 0x7fbd540af130 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd53fff640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540b4260 0x7fbd5413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd4affd640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd540b26e0 0x7fbd5413e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd537fe640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540af130 0x7fbd54134500 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbd4402a220 tx=0x7fbd440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd50ff9640 1 -- 172.21.15.87:0/2816845828 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44037040 con 0x7fbd540af130 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.391+0000 7fbd50ff9640 1 -- 172.21.15.87:0/2816845828 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd44042070 con 0x7fbd540af130 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.392+0000 7fbd50ff9640 1 -- 172.21.15.87:0/2816845828 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44030bb0 con 0x7fbd540af130 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.392+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd541411f0 con 0x7fbd540af130 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.392+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd54140c80 con 0x7fbd540af130 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.392+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd540728f0 con 0x7fbd540af130 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.393+0000 7fbd50ff9640 1 -- 172.21.15.87:0/2816845828 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd44047460 con 0x7fbd540af130 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.393+0000 7fbd50ff9640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbd3406be60 0x7fbd3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.394+0000 7fbd50ff9640 1 -- 172.21.15.87:0/2816845828 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbd440ab9f0 con 0x7fbd540af130 2024-05-09T07:54:52.411 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.394+0000 7fbd4affd640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbd3406be60 0x7fbd3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.394+0000 7fbd4affd640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbd3406be60 0x7fbd3406e320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c006fd0 tx=0x7fbd3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:52.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.398+0000 7fbd50ff9640 1 -- 172.21.15.87:0/2816845828 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbd540728f0 con 0x7fbd540af130 2024-05-09T07:54:52.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.574+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbd540691f0 con 0x7fbd540af130 2024-05-09T07:54:52.589 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.574+0000 7fbd50ff9640 1 -- 172.21.15.87:0/2816845828 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fbd44045360 con 0x7fbd540af130 2024-05-09T07:54:52.589 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-05-09T07:54:52.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.576+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbd3406be60 msgr2=0x7fbd3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.576+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbd3406be60 0x7fbd3406e320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c006fd0 tx=0x7fbd3c008040 comp rx=0 tx=0).stop 2024-05-09T07:54:52.591 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.576+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540af130 msgr2=0x7fbd54134500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.576+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540af130 0x7fbd54134500 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbd4402a220 tx=0x7fbd440046c0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.577+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 shutdown_connections 2024-05-09T07:54:52.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.577+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fbd3406be60 0x7fbd3406e320 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.577+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd540b4260 0x7fbd5413e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.577+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd540b26e0 0x7fbd5413e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.577+0000 7fbd5a0c3640 1 --2- 172.21.15.87:0/2816845828 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbd540af130 0x7fbd54134500 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.592 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.577+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 >> 172.21.15.87:0/2816845828 conn(0x7fbd540b5860 msgr2=0x7fbd5406c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:52.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.577+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 shutdown_connections 2024-05-09T07:54:52.593 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.577+0000 7fbd5a0c3640 1 -- 172.21.15.87:0/2816845828 wait complete. 2024-05-09T07:54:52.602 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T07:54:52.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.688+0000 7efec8895640 1 Processor -- start 2024-05-09T07:54:52.703 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.688+0000 7efec8895640 1 -- start start 2024-05-09T07:54:52.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec8895640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efec4072cb0 0x7efec413f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec8895640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec40b6240 con 0x7efec413f990 2024-05-09T07:54:52.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec8895640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec413fe20 con 0x7efec40b5e60 2024-05-09T07:54:52.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec8895640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7efec40b2cb0 con 0x7efec4072cb0 2024-05-09T07:54:52.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec2d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7efec413f990 0x7efec414ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41406/0 (socket says 172.21.15.87:41406) 2024-05-09T07:54:52.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec2d9d640 1 -- 172.21.15.87:0/3767468 learned_addr learned my addr 172.21.15.87:0/3767468 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21021579 0 0) 0x7efec40b6240 con 0x7efec413f990 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeb0003520 con 0x7efec413f990 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efeb9d9b640 1 --2- 172.21.15.87:0/3767468 >> v2:172.21.15.110:3300/0 conn(0x7efec4072cb0 0x7efec413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3896998086 0 0) 0x7efeb0003520 con 0x7efec413f990 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 >> v2:172.21.15.110:3300/0 conn(0x7efec4072cb0 msgr2=0x7efec413f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 --2- 172.21.15.87:0/3767468 >> v2:172.21.15.110:3300/0 conn(0x7efec4072cb0 0x7efec413f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 >> v1:172.21.15.110:6789/0 conn(0x7efec40b5e60 legacy=0x7efec4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec40b5570 con 0x7efec413f990 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7efebc0019f0 con 0x7efec413f990 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efeb9d9b640 1 --2- 172.21.15.87:0/3767468 >> v2:172.21.15.110:3300/0 conn(0x7efec4072cb0 0x7efec413f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 >> v1:172.21.15.87:6789/0 conn(0x7efec413f990 legacy=0x7efec414ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efeb00039b0 0x7efeb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb0004800 0x7efeb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.707 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efeb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efeb000c180 con 0x7efeb00052e0 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efeb000c330 con 0x7efeb0004800 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7efeb000c530 con 0x7efeb00039b0 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.689+0000 7efec2d9d640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efeb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.690+0000 7efeb9d9b640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb0004800 0x7efeb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.690+0000 7efec259c640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efeb00039b0 0x7efeb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.690+0000 7efec2d9d640 1 -- 172.21.15.87:0/3767468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efeb00039b0 msgr2=0x7efeb0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.690+0000 7efec2d9d640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efeb00039b0 0x7efeb0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.690+0000 7efec2d9d640 1 -- 172.21.15.87:0/3767468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb0004800 msgr2=0x7efeb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.690+0000 7efec2d9d640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb0004800 0x7efeb0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.690+0000 7efec2d9d640 1 -- 172.21.15.87:0/3767468 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb0003520 con 0x7efeb00052e0 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.690+0000 7efec2d9d640 1 -- 172.21.15.87:0/3767468 reap_dead start 2024-05-09T07:54:52.708 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.690+0000 7efec2d9d640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efeb000b9c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efebc002230 tx=0x7efeb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9875cb145a40cb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc00a4a0 con 0x7efeb00052e0 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc02f070 con 0x7efeb00052e0 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec1d9b640 1 -- 172.21.15.87:0/3767468 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc02bcb0 con 0x7efeb00052e0 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec8895640 1 -- 172.21.15.87:0/3767468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 msgr2=0x7efeb000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec8895640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efeb000b9c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efebc002230 tx=0x7efeb0005830 comp rx=0 tx=0).stop 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec8895640 1 -- 172.21.15.87:0/3767468 shutdown_connections 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec8895640 1 --2- 172.21.15.87:0/3767468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efeb000b9c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec8895640 1 -- 172.21.15.87:0/3767468 >> 172.21.15.87:0/3767468 conn(0x7efec406c6a0 msgr2=0x7efec406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec8895640 1 -- 172.21.15.87:0/3767468 shutdown_connections 2024-05-09T07:54:52.709 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.691+0000 7efec8895640 1 -- 172.21.15.87:0/3767468 wait complete. 2024-05-09T07:54:52.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.692+0000 7efec8895640 1 Processor -- start 2024-05-09T07:54:52.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec8895640 1 -- start start 2024-05-09T07:54:52.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec8895640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efec4142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec8895640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec41428c0 0x7efec41447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec8895640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efec4144ce0 0x7efec41dabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec8895640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7efec4148df0 con 0x7efeb00052e0 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec8895640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efec40b31c0 con 0x7efec41428c0 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec8895640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7efec409ee00 con 0x7efec4144ce0 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efec4142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec259c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efec4142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60540/0 (socket says 172.21.15.87:60540) 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec259c640 1 -- 172.21.15.87:0/3982642783 learned_addr learned my addr 172.21.15.87:0/3982642783 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efeb9d9b640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec41428c0 0x7efec41447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec259c640 1 -- 172.21.15.87:0/3982642783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efec4144ce0 msgr2=0x7efec41dabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.713 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec259c640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efec4144ce0 0x7efec41dabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec259c640 1 -- 172.21.15.87:0/3982642783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec41428c0 msgr2=0x7efec41447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec259c640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec41428c0 0x7efec41447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.693+0000 7efec259c640 1 -- 172.21.15.87:0/3982642783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec41439e0 con 0x7efeb00052e0 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.694+0000 7efec259c640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efec4142380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efeb400f620 tx=0x7efeb400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.694+0000 7efebb7fe640 1 -- 172.21.15.87:0/3982642783 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb40053a0 con 0x7efeb00052e0 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.694+0000 7efebb7fe640 1 -- 172.21.15.87:0/3982642783 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb4018070 con 0x7efeb00052e0 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.694+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec4145fe0 con 0x7efeb00052e0 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.694+0000 7efebb7fe640 1 -- 172.21.15.87:0/3982642783 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4003830 con 0x7efeb00052e0 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.694+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec4145d00 con 0x7efeb00052e0 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.695+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec40691f0 con 0x7efeb00052e0 2024-05-09T07:54:52.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.695+0000 7efebb7fe640 1 -- 172.21.15.87:0/3982642783 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efeb40039d0 con 0x7efeb00052e0 2024-05-09T07:54:52.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.696+0000 7efebb7fe640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efea406be30 0x7efea406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:52.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.696+0000 7efeb9d9b640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efea406be30 0x7efea406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:52.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.696+0000 7efebb7fe640 1 -- 172.21.15.87:0/3982642783 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efeb408ab80 con 0x7efeb00052e0 2024-05-09T07:54:52.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.696+0000 7efeb9d9b640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efea406be30 0x7efea406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efec4142cc0 tx=0x7efeac008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:52.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.700+0000 7efebb7fe640 1 -- 172.21.15.87:0/3982642783 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7efeb40595c0 con 0x7efeb00052e0 2024-05-09T07:54:52.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.911+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efec413d2c0 con 0x7efeb00052e0 2024-05-09T07:54:52.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.911+0000 7efebb7fe640 1 -- 172.21.15.87:0/3982642783 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7efeb4058ec0 con 0x7efeb00052e0 2024-05-09T07:54:52.926 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:52.926 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/138437726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":138437726},{"type":"v1","addr":"172.21.15.110:6833","nonce":138437726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T07:54:36.428491+0000","modified":"2024-05-09T07:54:38.820976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2148825985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2148825985},{"type":"v1","addr":"172.21.15.87:6835","nonce":2148825985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-05-09T07:54:52.926 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2024-05-09T07:54:52.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efea406be30 msgr2=0x7efea406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efea406be30 0x7efea406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efec4142cc0 tx=0x7efeac008040 comp rx=0 tx=0).stop 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 msgr2=0x7efec4142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efec4142380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efeb400f620 tx=0x7efeb400fae0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 shutdown_connections 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7efea406be30 0x7efea406e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efec4144ce0 0x7efec41dabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec41428c0 0x7efec41447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 --2- 172.21.15.87:0/3982642783 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efeb00052e0 0x7efec4142380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 >> 172.21.15.87:0/3982642783 conn(0x7efec406c6a0 msgr2=0x7efec40b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.913+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 shutdown_connections 2024-05-09T07:54:52.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:52.914+0000 7efec8895640 1 -- 172.21.15.87:0/3982642783 wait complete. 2024-05-09T07:54:52.940 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T07:54:53.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.025+0000 7f3254238640 1 Processor -- start 2024-05-09T07:54:53.040 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.025+0000 7f3254238640 1 -- start start 2024-05-09T07:54:53.046 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3254238640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f324c0af900 0x7f324c0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3254238640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f324c0b4920 0x7f324c0b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3254238640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324c0b3770 con 0x7f324c0af1b0 2024-05-09T07:54:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3254238640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f324c0b3d80 con 0x7f324c0af900 2024-05-09T07:54:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3254238640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f324c0b0ed0 con 0x7f324c0b4920 2024-05-09T07:54:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3251fd4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f324c0af900 0x7f324c0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3251fd4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f324c0af900 0x7f324c0b28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60556/0 (socket says 172.21.15.87:60556) 2024-05-09T07:54:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3251fd4640 1 -- 172.21.15.87:0/2489395277 learned_addr learned my addr 172.21.15.87:0/2489395277 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f32527d5640 1 --2- 172.21.15.87:0/2489395277 >> v2:172.21.15.110:3300/0 conn(0x7f324c0b4920 0x7f324c0b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.047 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3251fd4640 1 -- 172.21.15.87:0/2489395277 >> v2:172.21.15.110:3300/0 conn(0x7f324c0b4920 msgr2=0x7f324c0b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3251fd4640 1 --2- 172.21.15.87:0/2489395277 >> v2:172.21.15.110:3300/0 conn(0x7f324c0b4920 0x7f324c0b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3251fd4640 1 -- 172.21.15.87:0/2489395277 >> v1:172.21.15.110:6789/0 conn(0x7f324c0af1b0 legacy=0x7f324c0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f3251fd4640 1 -- 172.21.15.87:0/2489395277 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324c0b5530 con 0x7f324c0af900 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.026+0000 7f32527d5640 1 --2- 172.21.15.87:0/2489395277 >> v2:172.21.15.110:3300/0 conn(0x7f324c0b4920 0x7f324c0b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3251fd4640 1 --2- 172.21.15.87:0/2489395277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 0x7f324c0b28e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f324c0b6510 tx=0x7f324802c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2edcbc948087e02 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3250fd2640 1 -- 172.21.15.87:0/2489395277 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248031710 con 0x7f324c0af900 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3250fd2640 1 -- 172.21.15.87:0/2489395277 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32480318b0 con 0x7f324c0af900 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3250fd2640 1 -- 172.21.15.87:0/2489395277 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248031c80 con 0x7f324c0af900 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3254238640 1 -- 172.21.15.87:0/2489395277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 msgr2=0x7f324c0b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3254238640 1 --2- 172.21.15.87:0/2489395277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 0x7f324c0b28e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f324c0b6510 tx=0x7f324802c7a0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3254238640 1 -- 172.21.15.87:0/2489395277 shutdown_connections 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3254238640 1 --2- 172.21.15.87:0/2489395277 >> v2:172.21.15.110:3300/0 conn(0x7f324c0b4920 0x7f324c0b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.048 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3254238640 1 --2- 172.21.15.87:0/2489395277 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 0x7f324c0b28e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.027+0000 7f3254238640 1 -- 172.21.15.87:0/2489395277 >> 172.21.15.87:0/2489395277 conn(0x7f324c06c6a0 msgr2=0x7f324c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.028+0000 7f3254238640 1 -- 172.21.15.87:0/2489395277 shutdown_connections 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.028+0000 7f3254238640 1 -- 172.21.15.87:0/2489395277 wait complete. 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.028+0000 7f3254238640 1 Processor -- start 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.028+0000 7f3254238640 1 -- start start 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f3254238640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f324c0af1b0 0x7f324c0b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f3254238640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 0x7f324c1d8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f3254238640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324c0b4920 0x7f324c1d94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f3254238640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f324c0ade30 con 0x7f324c0af900 2024-05-09T07:54:53.049 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f3254238640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f324c0afce0 con 0x7f324c0af1b0 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f3254238640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f324c0adfb0 con 0x7f324c0b4920 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f32517d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 0x7f324c1d8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f32517d3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 0x7f324c1d8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60564/0 (socket says 172.21.15.87:60564) 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f32517d3640 1 -- 172.21.15.87:0/699988831 learned_addr learned my addr 172.21.15.87:0/699988831 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f3251fd4640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f324c0af1b0 0x7f324c0b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f32527d5640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324c0b4920 0x7f324c1d94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f32517d3640 1 -- 172.21.15.87:0/699988831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324c0b4920 msgr2=0x7f324c1d94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f32517d3640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324c0b4920 0x7f324c1d94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f32517d3640 1 -- 172.21.15.87:0/699988831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f324c0af1b0 msgr2=0x7f324c0b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f32517d3640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f324c0af1b0 0x7f324c0b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.029+0000 7f32517d3640 1 -- 172.21.15.87:0/699988831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324c09be30 con 0x7f324c0af900 2024-05-09T07:54:53.050 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.030+0000 7f32517d3640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 0x7f324c1d8f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c430 tx=0x7f323c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.030+0000 7f32427fc640 1 -- 172.21.15.87:0/699988831 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c011790 con 0x7f324c0af900 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.030+0000 7f32427fc640 1 -- 172.21.15.87:0/699988831 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323c017070 con 0x7f324c0af900 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.030+0000 7f32427fc640 1 -- 172.21.15.87:0/699988831 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c011b70 con 0x7f324c0af900 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.030+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f324c09aae0 con 0x7f324c0af900 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.030+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f324c09ba70 con 0x7f324c0af900 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.031+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f324c0691f0 con 0x7f324c0af900 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.031+0000 7f32427fc640 1 -- 172.21.15.87:0/699988831 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f323c011d10 con 0x7f324c0af900 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.032+0000 7f32427fc640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f323006be30 0x7f323006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.032+0000 7f32427fc640 1 -- 172.21.15.87:0/699988831 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f323c08ac40 con 0x7f324c0af900 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.032+0000 7f3251fd4640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f323006be30 0x7f323006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.051 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.032+0000 7f3251fd4640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f323006be30 0x7f323006e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3248036000 tx=0x7f3248031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.052 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.036+0000 7f32427fc640 1 -- 172.21.15.87:0/699988831 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f323c059680 con 0x7f324c0af900 2024-05-09T07:54:53.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.216+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f324c0b8070 con 0x7f324c0af900 2024-05-09T07:54:53.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.217+0000 7f32427fc640 1 -- 172.21.15.87:0/699988831 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16581 (secure 0 0 0) 0x7f323c058f80 con 0x7f324c0af900 2024-05-09T07:54:53.233 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:53.233 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":21,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:54:38.084989+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T07:54:53.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f323006be30 msgr2=0x7f323006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f323006be30 0x7f323006e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3248036000 tx=0x7f3248031000 comp rx=0 tx=0).stop 2024-05-09T07:54:53.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 msgr2=0x7f324c1d8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 0x7f324c1d8f70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c430 tx=0x7f323c00c8f0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 shutdown_connections 2024-05-09T07:54:53.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f323006be30 0x7f323006e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f324c0b4920 0x7f324c1d94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f324c0af900 0x7f324c1d8f70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 --2- 172.21.15.87:0/699988831 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f324c0af1b0 0x7f324c0b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 >> 172.21.15.87:0/699988831 conn(0x7f324c06c6a0 msgr2=0x7f324c0b6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 shutdown_connections 2024-05-09T07:54:53.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.219+0000 7f3254238640 1 -- 172.21.15.87:0/699988831 wait complete. 2024-05-09T07:54:53.246 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T07:54:53.348 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.333+0000 7f9280b9e640 1 Processor -- start 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.333+0000 7f9280b9e640 1 -- start start 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.333+0000 7f9280b9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f927c0b5e60 0x7f927c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.333+0000 7f9280b9e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f927c0b2940 0x7f927c147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.333+0000 7f9280b9e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c0b6240 con 0x7f927c0b5330 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.333+0000 7f9280b9e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f927c0b0470 con 0x7f927c0b2940 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.333+0000 7f9280b9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f927c0b1580 con 0x7f927c0b5e60 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.334+0000 7f927ad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f927c0b2940 0x7f927c147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.334+0000 7f927ad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f927c0b2940 0x7f927c147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60576/0 (socket says 172.21.15.87:60576) 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.334+0000 7f927ad9d640 1 -- 172.21.15.87:0/3234380968 learned_addr learned my addr 172.21.15.87:0/3234380968 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.334+0000 7f927ad9d640 1 -- 172.21.15.87:0/3234380968 >> v2:172.21.15.110:3300/0 conn(0x7f927c0b5e60 msgr2=0x7f927c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.334+0000 7f927ad9d640 1 --2- 172.21.15.87:0/3234380968 >> v2:172.21.15.110:3300/0 conn(0x7f927c0b5e60 0x7f927c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.349 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.334+0000 7f927ad9d640 1 -- 172.21.15.87:0/3234380968 >> v1:172.21.15.110:6789/0 conn(0x7f927c0b5330 legacy=0x7f927c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.350 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.334+0000 7f927ad9d640 1 -- 172.21.15.87:0/3234380968 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c0b1860 con 0x7f927c0b2940 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.334+0000 7f927ad9d640 1 --2- 172.21.15.87:0/3234380968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 0x7f927c147bd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f927c06dc50 tx=0x7f927402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5d886345d5bb94 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9279d9b640 1 -- 172.21.15.87:0/3234380968 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274036070 con 0x7f927c0b2940 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9279d9b640 1 -- 172.21.15.87:0/3234380968 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9274031600 con 0x7f927c0b2940 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9279d9b640 1 -- 172.21.15.87:0/3234380968 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927402ae60 con 0x7f927c0b2940 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9280b9e640 1 -- 172.21.15.87:0/3234380968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 msgr2=0x7f927c147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9280b9e640 1 --2- 172.21.15.87:0/3234380968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 0x7f927c147bd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f927c06dc50 tx=0x7f927402a680 comp rx=0 tx=0).stop 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9280b9e640 1 -- 172.21.15.87:0/3234380968 shutdown_connections 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9280b9e640 1 --2- 172.21.15.87:0/3234380968 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 0x7f927c147bd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9280b9e640 1 --2- 172.21.15.87:0/3234380968 >> v2:172.21.15.110:3300/0 conn(0x7f927c0b5e60 0x7f927c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9280b9e640 1 -- 172.21.15.87:0/3234380968 >> 172.21.15.87:0/3234380968 conn(0x7f927c06c6a0 msgr2=0x7f927c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.354 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9280b9e640 1 -- 172.21.15.87:0/3234380968 shutdown_connections 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.335+0000 7f9280b9e640 1 -- 172.21.15.87:0/3234380968 wait complete. 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.336+0000 7f9280b9e640 1 Processor -- start 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f9280b9e640 1 -- start start 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f9280b9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 0x7f927c071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f9280b9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f927c0b5330 0x7f927c1dd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f9280b9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f927c0b5e60 0x7f927c13de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f9280b9e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f927c0afae0 con 0x7f927c0b2940 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f9280b9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f927c0af960 con 0x7f927c0b5e60 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f9280b9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f927c148110 con 0x7f927c0b5330 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f927a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 0x7f927c071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f927a59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 0x7f927c071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60578/0 (socket says 172.21.15.87:60578) 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f927a59c640 1 -- 172.21.15.87:0/2443592018 learned_addr learned my addr 172.21.15.87:0/2443592018 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f927a59c640 1 -- 172.21.15.87:0/2443592018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f927c0b5330 msgr2=0x7f927c1dd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.355 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f927a59c640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f927c0b5330 0x7f927c1dd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f927a59c640 1 -- 172.21.15.87:0/2443592018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f927c0b5e60 msgr2=0x7f927c13de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f927ad9d640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f927c0b5e60 0x7f927c13de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.337+0000 7f927a59c640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f927c0b5e60 0x7f927c13de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.338+0000 7f927a59c640 1 -- 172.21.15.87:0/2443592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c142780 con 0x7f927c0b2940 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.338+0000 7f927a59c640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 0x7f927c071090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f926c00d990 tx=0x7f926c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.338+0000 7f92737fe640 1 -- 172.21.15.87:0/2443592018 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c01b070 con 0x7f927c0b2940 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.338+0000 7f92737fe640 1 -- 172.21.15.87:0/2443592018 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c00ed60 con 0x7f927c0b2940 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.338+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c1ce4a0 con 0x7f927c0b2940 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.338+0000 7f92737fe640 1 -- 172.21.15.87:0/2443592018 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c016680 con 0x7f927c0b2940 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.338+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c1cf0c0 con 0x7f927c0b2940 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.339+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f927c0691f0 con 0x7f927c0b2940 2024-05-09T07:54:53.356 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.339+0000 7f92737fe640 1 -- 172.21.15.87:0/2443592018 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f926c01e070 con 0x7f927c0b2940 2024-05-09T07:54:53.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.340+0000 7f92737fe640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f925c06be30 0x7f925c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.340+0000 7f9271d9b640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f925c06be30 0x7f925c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.340+0000 7f92737fe640 1 -- 172.21.15.87:0/2443592018 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f926c08cb80 con 0x7f927c0b2940 2024-05-09T07:54:53.357 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.340+0000 7f9271d9b640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f925c06be30 0x7f925c06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f927c1d4ab0 tx=0x7f9264007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.358 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.344+0000 7f92737fe640 1 -- 172.21.15.87:0/2443592018 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f926c05b5c0 con 0x7f927c0b2940 2024-05-09T07:54:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.553+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f927c1429f0 con 0x7f927c0b2940 2024-05-09T07:54:53.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.553+0000 7f92737fe640 1 -- 172.21.15.87:0/2443592018 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7f926c05aec0 con 0x7f927c0b2940 2024-05-09T07:54:53.569 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T07:54:53.569 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/138437726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":138437726},{"type":"v1","addr":"172.21.15.110:6833","nonce":138437726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T07:54:36.428491+0000","modified":"2024-05-09T07:54:38.820976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2148825985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2148825985},{"type":"v1","addr":"172.21.15.87:6835","nonce":2148825985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-05-09T07:54:53.569 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2024-05-09T07:54:53.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f925c06be30 msgr2=0x7f925c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f925c06be30 0x7f925c06e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f927c1d4ab0 tx=0x7f9264007990 comp rx=0 tx=0).stop 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 msgr2=0x7f927c071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 0x7f927c071090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f926c00d990 tx=0x7f926c00de50 comp rx=0 tx=0).stop 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 shutdown_connections 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f925c06be30 0x7f925c06e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f927c0b5330 0x7f927c1dd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f927c0b5e60 0x7f927c13de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 --2- 172.21.15.87:0/2443592018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f927c0b2940 0x7f927c071090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.555+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 >> 172.21.15.87:0/2443592018 conn(0x7f927c06c6a0 msgr2=0x7f927c0b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.556+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 shutdown_connections 2024-05-09T07:54:53.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.556+0000 7f9280b9e640 1 -- 172.21.15.87:0/2443592018 wait complete. 2024-05-09T07:54:53.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T07:54:36.428491+0000', 'modified': '2024-05-09T07:54:38.820976+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.87:6835/2148825985', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.87:6834', 'nonce': 2148825985}, {'type': 'v1', 'addr': '172.21.15.87:6835', 'nonce': 2148825985}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4269, 'qdb_cluster': [4269]} 2024-05-09T07:54:53.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T07:54:53.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-09T07:54:53.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.869+0000 7fd23a0d2640 1 Processor -- start 2024-05-09T07:54:53.884 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.869+0000 7fd23a0d2640 1 -- start start 2024-05-09T07:54:53.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.869+0000 7fd23a0d2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd2341417b0 0x7fd234141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.869+0000 7fd23a0d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd234147cf0 0x7fd234148160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.869+0000 7fd23a0d2640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2340b4780 con 0x7fd2340b4dd0 2024-05-09T07:54:53.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.869+0000 7fd23a0d2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fd234142150 con 0x7fd2341417b0 2024-05-09T07:54:53.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.869+0000 7fd23a0d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd2341486a0 con 0x7fd234147cf0 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.869+0000 7fd2337fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd2340b4dd0 0x7fd2340b51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:41418/0 (socket says 172.21.15.87:41418) 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.869+0000 7fd2337fe640 1 -- 172.21.15.87:0/1160779200 learned_addr learned my addr 172.21.15.87:0/1160779200 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd233fff640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd234147cf0 0x7fd234148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd232ffd640 1 --2- 172.21.15.87:0/1160779200 >> v2:172.21.15.110:3300/0 conn(0x7fd2341417b0 0x7fd234141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484794306 0 0) 0x7fd2340b4780 con 0x7fd2340b4dd0 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd21c003520 con 0x7fd2340b4dd0 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1814325935 0 0) 0x7fd21c003520 con 0x7fd2340b4dd0 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd234147cf0 msgr2=0x7fd234148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd234147cf0 0x7fd234148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 >> v2:172.21.15.110:3300/0 conn(0x7fd2341417b0 msgr2=0x7fd234141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 --2- 172.21.15.87:0/1160779200 >> v2:172.21.15.110:3300/0 conn(0x7fd2341417b0 0x7fd234141c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2340b5e20 con 0x7fd2340b4dd0 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7fd224001670 con 0x7fd2340b4dd0 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 >> v1:172.21.15.87:6789/0 conn(0x7fd2340b4dd0 legacy=0x7fd2340b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21c0039b0 0x7fd21c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c004800 0x7fd21c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd234147cf0 0x7fd21c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd234142150 con 0x7fd21c004800 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd2341486a0 con 0x7fd21c0039b0 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c00b9c0 con 0x7fd234147cf0 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd232ffd640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c004800 0x7fd21c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd2337fe640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21c0039b0 0x7fd21c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd233fff640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd234147cf0 0x7fd21c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd232ffd640 1 -- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd234147cf0 msgr2=0x7fd21c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd232ffd640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd234147cf0 0x7fd21c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd232ffd640 1 -- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21c0039b0 msgr2=0x7fd21c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd232ffd640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21c0039b0 0x7fd21c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.870+0000 7fd232ffd640 1 -- 172.21.15.87:0/1160779200 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c003520 con 0x7fd21c004800 2024-05-09T07:54:53.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.871+0000 7fd232ffd640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c004800 0x7fd21c004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd22800e170 tx=0x7fd21c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec5e9c66bd8f7c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.871+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228034020 con 0x7fd21c004800 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.871+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd228030430 con 0x7fd21c004800 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.871+0000 7fd2327fc640 1 -- 172.21.15.87:0/1160779200 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228009c10 con 0x7fd21c004800 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.872+0000 7fd23a0d2640 1 -- 172.21.15.87:0/1160779200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c004800 msgr2=0x7fd21c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.872+0000 7fd23a0d2640 1 --2- 172.21.15.87:0/1160779200 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd21c004800 0x7fd21c004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd22800e170 tx=0x7fd21c005830 comp rx=0 tx=0).stop 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.872+0000 7fd233fff640 1 -- 172.21.15.87:0/1160779200 reap_dead start 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.872+0000 7fd23a0d2640 1 -- 172.21.15.87:0/1160779200 shutdown_connections 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.872+0000 7fd23a0d2640 1 -- 172.21.15.87:0/1160779200 >> 172.21.15.87:0/1160779200 conn(0x7fd2340677b0 msgr2=0x7fd2340bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.872+0000 7fd23a0d2640 1 -- 172.21.15.87:0/1160779200 shutdown_connections 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.872+0000 7fd23a0d2640 1 -- 172.21.15.87:0/1160779200 wait complete. 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.873+0000 7fd23a0d2640 1 Processor -- start 2024-05-09T07:54:53.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.873+0000 7fd23a0d2640 1 -- start start 2024-05-09T07:54:53.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.873+0000 7fd23a0d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21c004800 0x7fd23413f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.873+0000 7fd23a0d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd23413fb60 0x7fd2341447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.873+0000 7fd23a0d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd234144ce0 0x7fd2341d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.873+0000 7fd23a0d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd2340b4080 con 0x7fd234144ce0 2024-05-09T07:54:53.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.873+0000 7fd23a0d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd2340b6370 con 0x7fd23413fb60 2024-05-09T07:54:53.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.873+0000 7fd23a0d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fd2340b4200 con 0x7fd21c004800 2024-05-09T07:54:53.899 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd233fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd234144ce0 0x7fd2341d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd233fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd234144ce0 0x7fd2341d0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60598/0 (socket says 172.21.15.87:60598) 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd233fff640 1 -- 172.21.15.87:0/266407499 learned_addr learned my addr 172.21.15.87:0/266407499 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd232ffd640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd23413fb60 0x7fd2341447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd2337fe640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21c004800 0x7fd23413f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd233fff640 1 -- 172.21.15.87:0/266407499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21c004800 msgr2=0x7fd23413f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd233fff640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21c004800 0x7fd23413f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd233fff640 1 -- 172.21.15.87:0/266407499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd23413fb60 msgr2=0x7fd2341447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd233fff640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd23413fb60 0x7fd2341447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd233fff640 1 -- 172.21.15.87:0/266407499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2341ce1d0 con 0x7fd234144ce0 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd233fff640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd234144ce0 0x7fd2341d0dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd2340b7100 tx=0x7fd22c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd21bfff640 1 -- 172.21.15.87:0/266407499 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c019020 con 0x7fd234144ce0 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd21bfff640 1 -- 172.21.15.87:0/266407499 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c004240 con 0x7fd234144ce0 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd23a0d2640 1 -- 172.21.15.87:0/266407499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd234142880 con 0x7fd234144ce0 2024-05-09T07:54:53.900 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd21bfff640 1 -- 172.21.15.87:0/266407499 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00f7a0 con 0x7fd234144ce0 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.874+0000 7fd23a0d2640 1 -- 172.21.15.87:0/266407499 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd234143cd0 con 0x7fd234144ce0 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.876+0000 7fd21bfff640 1 -- 172.21.15.87:0/266407499 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd22c01c020 con 0x7fd234144ce0 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.876+0000 7fd21bfff640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd22006be30 0x7fd22006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.876+0000 7fd21bfff640 1 -- 172.21.15.87:0/266407499 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd22c08b020 con 0x7fd234144ce0 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.876+0000 7fd2337fe640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd22006be30 0x7fd22006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.876+0000 7fd2337fe640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd22006be30 0x7fd22006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd224000fb0 tx=0x7fd224009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.877+0000 7fd23cdde740 1 Processor -- start 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.877+0000 7fd23cdde740 1 -- start start 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d433bee0 0x5649d4363310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 0x5649d4363850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd23cdde740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5649d42a34d0 con 0x5649d433f300 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd23cdde740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5649d424b3e0 con 0x5649d433bee0 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd23cdde740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x5649d429f490 con 0x5649d436d460 2024-05-09T07:54:53.901 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2337fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2337fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60602/0 (socket says 172.21.15.87:60602) 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2337fe640 1 -- 172.21.15.87:0/1453385353 learned_addr learned my addr 172.21.15.87:0/1453385353 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd232ffd640 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d433bee0 0x5649d4363310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd233fff640 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 0x5649d4363850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2337fe640 1 -- 172.21.15.87:0/1453385353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 msgr2=0x5649d4363850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2337fe640 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 0x5649d4363850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2337fe640 1 -- 172.21.15.87:0/1453385353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d433bee0 msgr2=0x5649d4363310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2337fe640 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d433bee0 0x5649d4363310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2337fe640 1 -- 172.21.15.87:0/1453385353 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649d3fb72d0 con 0x5649d433f300 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd232ffd640 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d433bee0 0x5649d4363310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2337fe640 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436cf20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd224007840 tx=0x7fd224014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acabfa77eae7a0d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2197fa640 1 -- 172.21.15.87:0/1453385353 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224015e40 con 0x5649d433f300 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2197fa640 1 -- 172.21.15.87:0/1453385353 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd224026070 con 0x5649d433f300 2024-05-09T07:54:53.902 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.878+0000 7fd2197fa640 1 -- 172.21.15.87:0/1453385353 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224021690 con 0x5649d433f300 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 -- 172.21.15.87:0/1453385353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 msgr2=0x5649d436cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436cf20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd224007840 tx=0x7fd224014000 comp rx=0 tx=0).stop 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 -- 172.21.15.87:0/1453385353 shutdown_connections 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 0x5649d4363850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d433bee0 0x5649d4363310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 --2- 172.21.15.87:0/1453385353 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436cf20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 -- 172.21.15.87:0/1453385353 >> 172.21.15.87:0/1453385353 conn(0x5649d433c9b0 msgr2=0x5649d433e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 -- 172.21.15.87:0/1453385353 shutdown_connections 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 -- 172.21.15.87:0/1453385353 wait complete. 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.879+0000 7fd23cdde740 1 -- start start 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd23cdde740 1 Processor -- start 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 0x5649d4382110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 0x5649d4382650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.903 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd23cdde740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5649d4367f00 con 0x5649d433f300 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd23cdde740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5649d425e8e0 con 0x5649d4372350 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd23cdde740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x5649d433e320 con 0x5649d436d460 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd23cdde740 10 client.0 _ll_register_callbacks cb 0x5649d422b9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd2337fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd2337fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60618/0 (socket says 172.21.15.87:60618) 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd2337fe640 1 -- 172.21.15.87:0/3040614494 learned_addr learned my addr 172.21.15.87:0/3040614494 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd232ffd640 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 0x5649d4382110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.880+0000 7fd233fff640 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 0x5649d4382650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2337fe640 1 -- 172.21.15.87:0/3040614494 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 msgr2=0x5649d4382110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2337fe640 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 0x5649d4382110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2337fe640 1 -- 172.21.15.87:0/3040614494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 msgr2=0x5649d4382650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2337fe640 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 0x5649d4382650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2337fe640 1 -- 172.21.15.87:0/3040614494 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649d40816b0 con 0x5649d433f300 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd233fff640 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 0x5649d4382650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:53.904 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2337fe640 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436b170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5649d42a5ae0 tx=0x7fd2340b6970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96894711c34cf47 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2127fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2127fc640 1 -- 172.21.15.87:0/3040614494 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22402b600 con 0x5649d433f300 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2127fc640 1 -- 172.21.15.87:0/3040614494 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd22402b7a0 con 0x5649d433f300 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd23cdde740 1 -- 172.21.15.87:0/3040614494 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd224026070 con 0x5649d433f300 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2127fc640 1 -- 172.21.15.87:0/3040614494 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fd224038050 con 0x5649d433f300 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd23cdde740 10 client.4665 fetch_fsmap learned FSMap version 7 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd23cdde740 1 -- 172.21.15.87:0/3040614494 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5649d4369220 con 0x5649d433f300 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2127fc640 1 -- 172.21.15.87:0/3040614494 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd224026070 con 0x5649d433f300 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd2127fc640 1 -- 172.21.15.87:0/3040614494 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 7) ==== 2284+0+0 (secure 0 0 0) 0x7fd22403b020 con 0x5649d433f300 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd23cdde740 10 client.4665 fetch_fsmap finished waiting for FSMap version 7 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd23cdde740 10 client.4665 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd23cdde740 20 client.4665 populate_metadata read hostname 'smithi087' 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd23cdde740 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] conn(0x5649d437eb50 0x5649d437ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd23cdde740 4 client.4665 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T07:54:53.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd23cdde740 1 -- 172.21.15.87:0/3040614494 --> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649d42b0c00 con 0x5649d437eb50 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.881+0000 7fd232ffd640 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] conn(0x5649d437eb50 0x5649d437ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd2127fc640 10 client.4665 ms_handle_connect on v2:172.21.15.87:6834/2148825985 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd232ffd640 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] conn(0x5649d437eb50 0x5649d437ef30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e3999b1b64ce41c server_cookie=f25f8b84f4072e32 in_seq=0 out_seq=0 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd2127fc640 1 -- 172.21.15.87:0/3040614494 <== mds.0 v2:172.21.15.87:6834/2148825985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5649d42b0c00 con 0x5649d437eb50 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd2127fc640 10 client.4665 handle_command_reply: tid=0 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd23cdde740 1 client.4665 shutdown 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd23cdde740 1 -- 172.21.15.87:0/3040614494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 msgr2=0x5649d436b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd23cdde740 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436b170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5649d42a5ae0 tx=0x7fd2340b6970 comp rx=0 tx=0).stop 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd23cdde740 1 -- 172.21.15.87:0/3040614494 shutdown_connections 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd23cdde740 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] conn(0x5649d437eb50 0x5649d437ef30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd23cdde740 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d436d460 0x5649d4382110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd23cdde740 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 0x5649d4382650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd2127fc640 0 client.4665 ms_handle_reset on v2:172.21.15.87:6834/2148825985 2024-05-09T07:54:53.906 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd23cdde740 1 --2- 172.21.15.87:0/3040614494 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d433f300 0x5649d436b170 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.882+0000 7fd23cdde740 1 -- 172.21.15.87:0/3040614494 >> 172.21.15.87:0/3040614494 conn(0x5649d433bee0 msgr2=0x5649d4362ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.883+0000 7fd23cdde740 1 -- 172.21.15.87:0/3040614494 shutdown_connections 2024-05-09T07:54:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.883+0000 7fd23cdde740 1 -- 172.21.15.87:0/3040614494 wait complete. 2024-05-09T07:54:53.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.883+0000 7fd23cdde740 20 client.4665 trim_cache size 0 max 16384 2024-05-09T07:54:53.915 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.901+0000 7fd23cdde740 1 Processor -- start 2024-05-09T07:54:53.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.901+0000 7fd23cdde740 1 -- start start 2024-05-09T07:54:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 0x5649d436f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d436d460 0x5649d43922e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d4372350 0x5649d4392820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd23cdde740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fd2341ea3a0 con 0x5649d4372350 2024-05-09T07:54:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd23cdde740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd2341e9500 con 0x5649d436d460 2024-05-09T07:54:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd23cdde740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x5649d4367f00 con 0x5649d433f300 2024-05-09T07:54:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd233fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d4372350 0x5649d4392820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.924 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd233fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d4372350 0x5649d4392820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60626/0 (socket says 172.21.15.87:60626) 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd233fff640 1 -- 172.21.15.87:0/1733400186 learned_addr learned my addr 172.21.15.87:0/1733400186 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd2337fe640 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 0x5649d436f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd232ffd640 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d436d460 0x5649d43922e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd233fff640 1 -- 172.21.15.87:0/1733400186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 msgr2=0x5649d436f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd233fff640 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 0x5649d436f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd233fff640 1 -- 172.21.15.87:0/1733400186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d436d460 msgr2=0x5649d43922e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd233fff640 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d436d460 0x5649d43922e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd233fff640 1 -- 172.21.15.87:0/1733400186 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649d4378e30 con 0x5649d4372350 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd232ffd640 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d436d460 0x5649d43922e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd233fff640 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d4372350 0x5649d4392820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd22c089600 tx=0x7fd22c059260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcf9f8368a516c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd218ff9640 1 -- 172.21.15.87:0/1733400186 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c061f40 con 0x5649d4372350 2024-05-09T07:54:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd218ff9640 1 -- 172.21.15.87:0/1733400186 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c071070 con 0x5649d4372350 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.902+0000 7fd218ff9640 1 -- 172.21.15.87:0/1733400186 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0559d0 con 0x5649d4372350 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 -- 172.21.15.87:0/1733400186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d4372350 msgr2=0x5649d4392820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d4372350 0x5649d4392820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd22c089600 tx=0x7fd22c059260 comp rx=0 tx=0).stop 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 -- 172.21.15.87:0/1733400186 shutdown_connections 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d4372350 0x5649d4392820 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d436d460 0x5649d43922e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 --2- 172.21.15.87:0/1733400186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 0x5649d436f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 -- 172.21.15.87:0/1733400186 >> 172.21.15.87:0/1733400186 conn(0x5649d433bee0 msgr2=0x5649d437ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 -- 172.21.15.87:0/1733400186 shutdown_connections 2024-05-09T07:54:53.926 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 -- 172.21.15.87:0/1733400186 wait complete. 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.903+0000 7fd23cdde740 1 -- start start 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd23cdde740 1 Processor -- start 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 0x5649d4361fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d436d460 0x5649d43e2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd23cdde740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 0x5649d43e2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd23cdde740 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x5649d433de60 con 0x5649d436d460 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd23cdde740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x5649d436b8c0 con 0x5649d4372350 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd23cdde740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x5649d436bb30 con 0x5649d433f300 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd23cdde740 10 client.0 _ll_register_callbacks cb 0x7fd22c011f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd232ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d436d460 0x5649d43e2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd232ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d436d460 0x5649d43e2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60628/0 (socket says 172.21.15.87:60628) 2024-05-09T07:54:53.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd232ffd640 1 -- 172.21.15.87:0/490392632 learned_addr learned my addr 172.21.15.87:0/490392632 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd2337fe640 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 0x5649d4361fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd233fff640 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 0x5649d43e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd232ffd640 1 -- 172.21.15.87:0/490392632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 msgr2=0x5649d4361fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd232ffd640 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 0x5649d4361fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd232ffd640 1 -- 172.21.15.87:0/490392632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 msgr2=0x5649d43e2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd232ffd640 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 0x5649d43e2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd232ffd640 1 -- 172.21.15.87:0/490392632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649d4363ae0 con 0x5649d436d460 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.904+0000 7fd2337fe640 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 0x5649d4361fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd232ffd640 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d436d460 0x5649d43e2030 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd22802af70 tx=0x7fd228004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0af4c6906c937e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd2127fc640 10 client.0 ms_handle_connect on v2:172.21.15.87:3300/0 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd2127fc640 1 -- 172.21.15.87:0/490392632 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228034040 con 0x5649d436d460 2024-05-09T07:54:53.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd2127fc640 1 -- 172.21.15.87:0/490392632 <== mon.0 v2:172.21.15.87:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd22804a540 con 0x5649d436d460 2024-05-09T07:54:53.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd23cdde740 1 -- 172.21.15.87:0/490392632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd22c071070 con 0x5649d436d460 2024-05-09T07:54:53.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd2127fc640 1 -- 172.21.15.87:0/490392632 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fd22804a740 con 0x5649d436d460 2024-05-09T07:54:53.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd23cdde740 10 client.4671 fetch_fsmap learned FSMap version 7 2024-05-09T07:54:53.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd23cdde740 1 -- 172.21.15.87:0/490392632 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5649d433b120 con 0x5649d436d460 2024-05-09T07:54:53.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd2127fc640 1 -- 172.21.15.87:0/490392632 <== mon.0 v2:172.21.15.87:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c071070 con 0x5649d436d460 2024-05-09T07:54:53.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd2127fc640 1 -- 172.21.15.87:0/490392632 <== mon.0 v2:172.21.15.87:3300/0 5 ==== fsmap(e 7) ==== 2284+0+0 (secure 0 0 0) 0x7fd22805a080 con 0x5649d436d460 2024-05-09T07:54:53.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd23cdde740 10 client.4671 fetch_fsmap finished waiting for FSMap version 7 2024-05-09T07:54:53.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd23cdde740 10 client.4671 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T07:54:53.929 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd23cdde740 20 client.4671 populate_metadata read hostname 'smithi087' 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd23cdde740 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] conn(0x5649d4362a10 0x5649d4362df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd23cdde740 4 client.4671 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd23cdde740 1 -- 172.21.15.87:0/490392632 --> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] -- command(tid 0: {"prefix": "status"}) -- 0x5649d42aaf50 con 0x5649d4362a10 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd2337fe640 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] conn(0x5649d4362a10 0x5649d4362df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.905+0000 7fd2127fc640 10 client.4671 ms_handle_connect on v2:172.21.15.87:6834/2148825985 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd2337fe640 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] conn(0x5649d4362a10 0x5649d4362df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaeb2082399daeae server_cookie=4420109a99c528a3 in_seq=0 out_seq=0 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd2127fc640 1 -- 172.21.15.87:0/490392632 <== mds.0 v2:172.21.15.87:6834/2148825985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5649d42aaf50 con 0x5649d4362a10 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd2127fc640 10 client.4671 handle_command_reply: tid=0 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 client.4671 shutdown 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 -- 172.21.15.87:0/490392632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d436d460 msgr2=0x5649d43e2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d436d460 0x5649d43e2030 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd22802af70 tx=0x7fd228004ab0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 -- 172.21.15.87:0/490392632 shutdown_connections 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.87:6834/2148825985,v1:172.21.15.87:6835/2148825985] conn(0x5649d4362a10 0x5649d4362df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5649d4372350 0x5649d43e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x5649d436d460 0x5649d43e2030 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd2127fc640 0 client.4671 ms_handle_reset on v2:172.21.15.87:6834/2148825985 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 --2- 172.21.15.87:0/490392632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5649d433f300 0x5649d4361fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 -- 172.21.15.87:0/490392632 >> 172.21.15.87:0/490392632 conn(0x5649d433bee0 msgr2=0x5649d436f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 -- 172.21.15.87:0/490392632 shutdown_connections 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 1 -- 172.21.15.87:0/490392632 wait complete. 2024-05-09T07:54:53.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.906+0000 7fd23cdde740 20 client.4671 trim_cache size 0 max 16384 2024-05-09T07:54:53.932 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T07:54:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "cluster_fsid": "afc7678c-ec1c-4af0-8515-296a1e5375c0", 2024-05-09T07:54:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "whoami": 0, 2024-05-09T07:54:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4269, 2024-05-09T07:54:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "want_state": "up:active", 2024-05-09T07:54:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "state": "up:active", 2024-05-09T07:54:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs", 2024-05-09T07:54:53.932 INFO:teuthology.orchestra.run.smithi087.stdout: "rank_uptime": 16.815572514999999, 2024-05-09T07:54:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 7, 2024-05-09T07:54:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch": 21, 2024-05-09T07:54:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_epoch_barrier": 21, 2024-05-09T07:54:53.933 INFO:teuthology.orchestra.run.smithi087.stdout: "uptime": 23.452262042000001 2024-05-09T07:54:53.933 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T07:54:53.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 -- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd22006be30 msgr2=0x7fd22006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd22006be30 0x7fd22006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd224000fb0 tx=0x7fd224009040 comp rx=0 tx=0).stop 2024-05-09T07:54:53.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 -- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd234144ce0 msgr2=0x7fd2341d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:53.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd234144ce0 0x7fd2341d0dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd2340b7100 tx=0x7fd22c011cf0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 -- 172.21.15.87:0/266407499 shutdown_connections 2024-05-09T07:54:53.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fd22006be30 0x7fd22006e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd234144ce0 0x7fd2341d0dd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd23413fb60 0x7fd2341447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 --2- 172.21.15.87:0/266407499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21c004800 0x7fd23413f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 -- 172.21.15.87:0/266407499 >> 172.21.15.87:0/266407499 conn(0x7fd2340677b0 msgr2=0x7fd2340b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 -- 172.21.15.87:0/266407499 shutdown_connections 2024-05-09T07:54:53.936 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:53.907+0000 7fd23a0d2640 1 -- 172.21.15.87:0/266407499 wait complete. 2024-05-09T07:54:53.936 INFO:teuthology.run_tasks:Running task sequential... 2024-05-09T07:54:53.945 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-09T07:54:53.945 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-09T07:54:53.946 INFO:teuthology.task.print:Enabling mgr modules 2024-05-09T07:54:53.946 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-09T07:54:53.971 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-09T07:54:53.971 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-09T07:54:53.971 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-09T07:54:53.971 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T07:54:53.971 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:53.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:53.972 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-09T07:54:53.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:53.988 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-05-09T07:54:54.054 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-05-09T07:54:54.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T07:54:54.056 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-09T07:54:54.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T07:54:54.195 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.181+0000 7f0a033f9640 1 Processor -- start 2024-05-09T07:54:54.196 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.181+0000 7f0a033f9640 1 -- start start 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.181+0000 7f0a033f9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09fc0b55d0 0x7f09fc14adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a033f9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 0x7f09fc1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a033f9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09fc0bde10 con 0x7f09fc0bda30 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a033f9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f09fc0b6120 con 0x7f09fc0b55d0 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a033f9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f09fc0b5c90 con 0x7f09fc14b2f0 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a00994640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09fc0b55d0 0x7f09fc14adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a01996640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 0x7f09fc1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a01195640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f09fc0bda30 0x7f09fc141850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:43898/0 (socket says 172.21.15.87:43898) 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a01195640 1 -- 172.21.15.87:0/4095354373 learned_addr learned my addr 172.21.15.87:0/4095354373 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a01996640 1 -- 172.21.15.87:0/4095354373 >> v2:172.21.15.110:3300/0 conn(0x7f09fc0b55d0 msgr2=0x7f09fc14adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T07:54:54.197 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a01996640 1 --2- 172.21.15.87:0/4095354373 >> v2:172.21.15.110:3300/0 conn(0x7f09fc0b55d0 0x7f09fc14adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a01996640 1 -- 172.21.15.87:0/4095354373 >> v1:172.21.15.110:6789/0 conn(0x7f09fc0bda30 legacy=0x7f09fc141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:54.198 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.182+0000 7f0a01996640 1 -- 172.21.15.87:0/4095354373 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09fc0b4d50 con 0x7f09fc14b2f0 2024-05-09T07:54:54.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.183+0000 7f0a01996640 1 --2- 172.21.15.87:0/4095354373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 0x7f09fc1520e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009d90 tx=0x7f09f402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53fe1cc5d02efffd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:54.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.183+0000 7f09f3fff640 1 -- 172.21.15.87:0/4095354373 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f4031600 con 0x7f09fc14b2f0 2024-05-09T07:54:54.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.183+0000 7f09f3fff640 1 -- 172.21.15.87:0/4095354373 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f40317a0 con 0x7f09fc14b2f0 2024-05-09T07:54:54.199 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.183+0000 7f09f3fff640 1 -- 172.21.15.87:0/4095354373 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f4031b70 con 0x7f09fc14b2f0 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.183+0000 7f0a033f9640 1 -- 172.21.15.87:0/4095354373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 msgr2=0x7f09fc1520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.183+0000 7f0a033f9640 1 --2- 172.21.15.87:0/4095354373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 0x7f09fc1520e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009d90 tx=0x7f09f402a5d0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.184+0000 7f0a033f9640 1 -- 172.21.15.87:0/4095354373 shutdown_connections 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.184+0000 7f0a033f9640 1 --2- 172.21.15.87:0/4095354373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 0x7f09fc1520e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.184+0000 7f0a033f9640 1 --2- 172.21.15.87:0/4095354373 >> v2:172.21.15.110:3300/0 conn(0x7f09fc0b55d0 0x7f09fc14adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.184+0000 7f0a033f9640 1 -- 172.21.15.87:0/4095354373 >> 172.21.15.87:0/4095354373 conn(0x7f09fc0675c0 msgr2=0x7f09fc0bd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.184+0000 7f0a033f9640 1 -- 172.21.15.87:0/4095354373 shutdown_connections 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.184+0000 7f0a033f9640 1 -- 172.21.15.87:0/4095354373 wait complete. 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a033f9640 1 Processor -- start 2024-05-09T07:54:54.200 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a033f9640 1 -- start start 2024-05-09T07:54:54.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a033f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09fc0b55d0 0x7f09fc13de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:54.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a033f9640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc0bda30 0x7f09fc0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:54.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a033f9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 0x7f09fc1e0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:54.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a033f9640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc0b4970 con 0x7f09fc0bda30 2024-05-09T07:54:54.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a033f9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc141f60 con 0x7f09fc0b55d0 2024-05-09T07:54:54.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a033f9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f09fc0b9730 con 0x7f09fc14b2f0 2024-05-09T07:54:54.203 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a00994640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc0bda30 0x7f09fc0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a00994640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc0bda30 0x7f09fc0b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:60632/0 (socket says 172.21.15.87:60632) 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.185+0000 7f0a00994640 1 -- 172.21.15.87:0/4203592018 learned_addr learned my addr 172.21.15.87:0/4203592018 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a01996640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 0x7f09fc1e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a01195640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09fc0b55d0 0x7f09fc13de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a00994640 1 -- 172.21.15.87:0/4203592018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 msgr2=0x7f09fc1e0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a00994640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 0x7f09fc1e0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a00994640 1 -- 172.21.15.87:0/4203592018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09fc0b55d0 msgr2=0x7f09fc13de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a00994640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09fc0b55d0 0x7f09fc13de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a00994640 1 -- 172.21.15.87:0/4203592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09fc1d49f0 con 0x7f09fc0bda30 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a00994640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc0bda30 0x7f09fc0b3100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00e840 tx=0x7f09ec00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f09f1ffb640 1 -- 172.21.15.87:0/4203592018 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec017070 con 0x7f09fc0bda30 2024-05-09T07:54:54.204 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f09f1ffb640 1 -- 172.21.15.87:0/4203592018 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec00c940 con 0x7f09fc0bda30 2024-05-09T07:54:54.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f09f1ffb640 1 -- 172.21.15.87:0/4203592018 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00cd10 con 0x7f09fc0bda30 2024-05-09T07:54:54.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09fc144e70 con 0x7f09fc0bda30 2024-05-09T07:54:54.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.186+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09fc13e3c0 con 0x7f09fc0bda30 2024-05-09T07:54:54.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.187+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09fc0691f0 con 0x7f09fc0bda30 2024-05-09T07:54:54.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.188+0000 7f09f1ffb640 1 -- 172.21.15.87:0/4203592018 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09ec01a070 con 0x7f09fc0bda30 2024-05-09T07:54:54.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.188+0000 7f09f1ffb640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09e006be30 0x7f09e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T07:54:54.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.188+0000 7f09f1ffb640 1 -- 172.21.15.87:0/4203592018 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f09ec08b100 con 0x7f09fc0bda30 2024-05-09T07:54:54.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.188+0000 7f0a01195640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09e006be30 0x7f09e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T07:54:54.205 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.188+0000 7f0a01195640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09e006be30 0x7f09e006e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0bcbd0 tx=0x7f09f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T07:54:54.207 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.192+0000 7f09f1ffb640 1 -- 172.21.15.87:0/4203592018 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f09ec059b40 con 0x7f09fc0bda30 2024-05-09T07:54:54.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.399+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f09fc1409a0 con 0x7f09fc0bda30 2024-05-09T07:54:54.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.400+0000 7f09f1ffb640 1 -- 172.21.15.87:0/4203592018 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f09ec059440 con 0x7f09fc0bda30 2024-05-09T07:54:54.415 INFO:teuthology.orchestra.run.smithi087.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T07:54:54.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09e006be30 msgr2=0x7f09e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:54.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09e006be30 0x7f09e006e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0bcbd0 tx=0x7f09f8009040 comp rx=0 tx=0).stop 2024-05-09T07:54:54.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc0bda30 msgr2=0x7f09fc0b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T07:54:54.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc0bda30 0x7f09fc0b3100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00e840 tx=0x7f09ec00ed00 comp rx=0 tx=0).stop 2024-05-09T07:54:54.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 shutdown_connections 2024-05-09T07:54:54.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f09e006be30 0x7f09e006e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09fc14b2f0 0x7f09fc1e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f09fc0bda30 0x7f09fc0b3100 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 --2- 172.21.15.87:0/4203592018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09fc0b55d0 0x7f09fc13de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T07:54:54.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 >> 172.21.15.87:0/4203592018 conn(0x7f09fc0675c0 msgr2=0x7f09fc13fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T07:54:54.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 shutdown_connections 2024-05-09T07:54:54.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54.402+0000 7f0a033f9640 1 -- 172.21.15.87:0/4203592018 wait complete. 2024-05-09T07:54:54.427 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T07:54:54.427 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T07:54:54.428 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-05-09T07:54:54.428 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T07:54:54.428 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:54.428 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T07:54:54.428 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T07:54:54.428 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T07:54:54.428 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T07:54:54.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:54.428 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-05-09T07:54:54.444 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T07:54:54.444 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T07:54:54.444 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T07:54:54.444 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-09T07:54:54.444 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-05-09T07:54:54.444 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-09T07:54:54.444 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42726sec preferred_lft 42726sec 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-05-09T07:54:54.445 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-05-09T07:54:54.446 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T07:54:54.446 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T07:54:54.446 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-09T07:54:54.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-05-09T07:54:54.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-05-09T07:54:54.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-05-09T07:54:54.446 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T07:54:54.446 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-09T07:54:54.534 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T07:54:54.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T07:54:54.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:54.629 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T07:54:54.654 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-05-09T07:54:54.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:54.656 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-05-09T07:54:54.744 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-05-09T07:54:54.744 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T07:54:54.744 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T07:54:54.745 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T07:54:54.745 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T07:54:54.745 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T07:54:54.745 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-09T07:54:54.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T07:54:54.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T07:54:54.746 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T07:54:54.746 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-09T07:54:54.795 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T07:54:54.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T07:54:54.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:54.982 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-09T07:54:54.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:54.998 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-05-09T07:54:55.055 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T07:54:55.055 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-09T07:54:55.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T07:54:55.056 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T07:54:55.056 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-09T07:54:55.145 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T07:54:55.169 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T07:54:55.175 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T07:54:55.176 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T07:54:55.176 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-09T07:54:55.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T07:54:55.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T07:54:55.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T07:54:55.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T07:54:55.176 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T07:54:55.176 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-09T07:54:55.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T07:54:55.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T07:54:55.303 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T07:54:55.303 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-05-09T07:54:55.303 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-05-09T07:54:55.303 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T07:54:55.303 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-05-09T07:54:55.352 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T07:54:55.374 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T07:54:55.380 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-09T07:54:55.381 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T07:54:55.381 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:55.396 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T07:54:55.396 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T07:54:55.396 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:55.451 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-09T07:54:55.517 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T07:54:55.573 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-09T07:54:55.573 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-09T07:54:55.573 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-09T07:54:55.573 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-09T07:54:55.573 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-09T07:54:55.573 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-09T07:54:55.574 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T07:54:55.575 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T07:54:55.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:55.576 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-09T07:54:55.632 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-09T07:54:55.632 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-09T07:54:55.674 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-05-09T07:54:55.699 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-05-09T07:54:55.756 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-05-09T07:54:55.756 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-05-09T07:54:55.756 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-05-09T07:54:55.756 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-05-09T07:54:55.756 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-05-09T07:54:55.756 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-05-09T07:54:55.756 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-05-09T07:54:55.756 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-sysctl.service 2024-05-09T07:54:55.757 INFO:teuthology.orchestra.run.smithi087.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-0 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-1 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-2 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph/osd/ceph-3 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T07:54:55.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:55.759 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-05-09T07:54:55.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-05-09T07:54:55.751+0000 7f8b68327480 -1 init, newargv = 0x55e15cfa4500 newargc=15 2024-05-09T07:54:55.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[44567]: starting ceph client 2024-05-09T07:54:55.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[44567]: starting fuse 2024-05-09T07:54:55.782 INFO:teuthology.orchestra.run.smithi087.stdout:41 2024-05-09T07:54:55.782 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-09T07:54:55.782 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-05-09T07:54:55.782 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-05-09T07:54:55.782 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-05-09T07:54:55.782 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-05-09T07:54:55.782 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-09T07:54:55.783 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-09T07:54:55.784 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-05-09T07:54:55.784 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-05-09T07:54:55.784 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-05-09T07:54:55.784 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-09T07:54:55.784 DEBUG:teuthology.orchestra.run.smithi087:> 2024-05-09T07:54:55.784 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-05-09T07:54:55.784 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-05-09T07:54:55.902 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.44567.asok 2024-05-09T07:54:55.905 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T07:54:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T07:54:55.913 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44567.asok 2024-05-09T07:54:55.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:55.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44567.asok status 2024-05-09T07:54:56.048 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T07:54:56.048 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-05-09T07:54:56.048 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "96805dcf909541c4ca9a1e90258de8ae5b6fa1bc", 2024-05-09T07:54:56.048 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 19.0.0-2515-g96805dcf (96805dcf909541c4ca9a1e90258de8ae5b6fa1bc) squid (dev)", 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "44567", 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4680, 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4680 2024-05-09T07:54:56.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1702304172 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "192.168.0.1:0", 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1702304172 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4680 192.168.0.1:0/1702304172", 2024-05-09T07:54:56.050 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "192.168.0.1:0/1702304172", 2024-05-09T07:54:56.051 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-05-09T07:54:56.051 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 7, 2024-05-09T07:54:56.051 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 21, 2024-05-09T07:54:56.051 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-05-09T07:54:56.051 INFO:teuthology.orchestra.run.smithi087.stdout: "blocklisted": false, 2024-05-09T07:54:56.051 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-05-09T07:54:56.051 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T07:54:56.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:56.057 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-05-09T07:54:56.057 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:56.073 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-05-09T07:54:56.073 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:56.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T07:54:56.073 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:56.139 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-09T07:54:56.149 INFO:teuthology.run_tasks:Running task workunit... 2024-05-09T07:54:56.159 INFO:tasks.workunit:Pulling workunits from ref be85c202969d25af6e130678e7d73a20e9c4ca11 2024-05-09T07:54:56.160 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T07:54:56.160 INFO:tasks.workunit:timeout=3h 2024-05-09T07:54:56.160 INFO:tasks.workunit:cleanup=True 2024-05-09T07:54:56.160 DEBUG:teuthology.orchestra.run.smithi087:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:56.196 INFO:teuthology.orchestra.run.smithi087.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:56.196 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-09T07:54:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-05-09T07:54:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T07:54:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-09T07:54:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-09T07:54:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-05-09 07:54:37.092157579 +0000 2024-05-09T07:54:56.196 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-05-09 07:54:56.123337716 +0000 2024-05-09T07:54:56.196 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-05-09T07:54:56.196 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T07:54:56.197 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T07:54:56.267 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout be85c202969d25af6e130678e7d73a20e9c4ca11 2024-05-09T07:54:56.324 INFO:tasks.workunit.client.0.smithi087.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T07:55:09.690 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:55:09.693 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:55:39.837 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:55:39.840 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:56:07.453 INFO:tasks.workunit.client.0.smithi087.stderr:Note: switching to 'be85c202969d25af6e130678e7d73a20e9c4ca11'. 2024-05-09T07:56:07.453 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:07.453 INFO:tasks.workunit.client.0.smithi087.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T07:56:07.453 INFO:tasks.workunit.client.0.smithi087.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T07:56:07.453 INFO:tasks.workunit.client.0.smithi087.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T07:56:07.453 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:07.453 INFO:tasks.workunit.client.0.smithi087.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr: git switch -c 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr:Or undo this operation with: 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr: git switch - 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:07.454 INFO:tasks.workunit.client.0.smithi087.stderr:HEAD is now at be85c202969 Merge pull request #57242 from cbodley/wip-65767-squid 2024-05-09T07:56:07.456 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T07:56:07.496 INFO:tasks.workunit.client.0.smithi087.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T07:56:07.499 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T07:56:07.499 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T07:56:08.184 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T07:56:08.242 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T07:56:08.284 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T07:56:08.285 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T07:56:08.286 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T07:56:08.325 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T07:56:08.328 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T07:56:08.328 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T07:56:08.385 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-05-09T07:56:08.386 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-05-09T07:56:08.387 DEBUG:teuthology.orchestra.run.smithi087:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=be85c202969d25af6e130678e7d73a20e9c4ca11 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-05-09T07:56:08.451 INFO:tasks.workunit.client.0.smithi087.stdout:getting blogbench 2024-05-09T07:56:08.451 INFO:tasks.workunit.client.0.smithi087.stderr:+ echo 'getting blogbench' 2024-05-09T07:56:08.451 INFO:tasks.workunit.client.0.smithi087.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-05-09T07:56:08.468 INFO:tasks.workunit.client.0.smithi087.stderr:--2024-05-09 07:56:08-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-05-09T07:56:08.469 INFO:tasks.workunit.client.0.smithi087.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-05-09T07:56:08.490 INFO:tasks.workunit.client.0.smithi087.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-05-09T07:56:08.511 INFO:tasks.workunit.client.0.smithi087.stderr:HTTP request sent, awaiting response... 200 OK 2024-05-09T07:56:08.511 INFO:tasks.workunit.client.0.smithi087.stderr:Length: 103355 (101K) [application/octet-stream] 2024-05-09T07:56:08.512 INFO:tasks.workunit.client.0.smithi087.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-05-09T07:56:08.515 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:08.552 INFO:tasks.workunit.client.0.smithi087.stderr: 0K .......... .......... .......... .......... .......... 49% 1.22M 0s 2024-05-09T07:56:08.573 INFO:tasks.workunit.client.0.smithi087.stderr: 50K .......... .......... .......... .......... .......... 99% 2.41M 0s 2024-05-09T07:56:08.573 INFO:tasks.workunit.client.0.smithi087.stderr: 100K 100% 1.74T=0.06s 2024-05-09T07:56:08.573 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:08.573 INFO:tasks.workunit.client.0.smithi087.stderr:2024-05-09 07:56:08 (1.64 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-05-09T07:56:08.573 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-05-09T07:56:08.574 INFO:tasks.workunit.client.0.smithi087.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-05-09T07:56:08.606 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/ 2024-05-09T07:56:08.607 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/m4/ 2024-05-09T07:56:08.608 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-05-09T07:56:08.610 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/man/ 2024-05-09T07:56:08.612 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/man/blogbench.8 2024-05-09T07:56:08.614 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/man/Makefile.am 2024-05-09T07:56:08.616 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/man/Makefile.in 2024-05-09T07:56:08.619 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/ 2024-05-09T07:56:08.621 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/mysnprintf.c 2024-05-09T07:56:08.626 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/mysnprintf.h 2024-05-09T07:56:08.626 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/blogbench.c 2024-05-09T07:56:08.628 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/blogbench.h 2024-05-09T07:56:08.631 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/fakesnprintf.c 2024-05-09T07:56:08.633 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/fakesnprintf.h 2024-05-09T07:56:08.636 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/blogbench_p.h 2024-05-09T07:56:08.639 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-05-09T07:56:08.641 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-05-09T07:56:08.644 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/Makefile.am 2024-05-09T07:56:08.646 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/Makefile.in 2024-05-09T07:56:08.649 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/process.c 2024-05-09T07:56:08.651 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/globals.h 2024-05-09T07:56:08.653 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/commenter.c 2024-05-09T07:56:08.656 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/rewriter.c 2024-05-09T07:56:08.658 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/reader.c 2024-05-09T07:56:08.660 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/writer.c 2024-05-09T07:56:08.663 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/src/helpers.c 2024-05-09T07:56:08.666 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/NEWS 2024-05-09T07:56:08.668 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/compile 2024-05-09T07:56:08.670 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/depcomp 2024-05-09T07:56:08.673 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/aclocal.m4 2024-05-09T07:56:08.676 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/README 2024-05-09T07:56:08.678 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/configure 2024-05-09T07:56:08.685 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/configure.ac 2024-05-09T07:56:08.688 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/config.guess 2024-05-09T07:56:08.691 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/install-sh 2024-05-09T07:56:08.693 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/config.sub 2024-05-09T07:56:08.696 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/missing 2024-05-09T07:56:08.699 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/mkinstalldirs 2024-05-09T07:56:08.701 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/Makefile.am 2024-05-09T07:56:08.703 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/Makefile.in 2024-05-09T07:56:08.706 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/config.h.in 2024-05-09T07:56:08.709 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/AUTHORS 2024-05-09T07:56:08.711 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/INSTALL 2024-05-09T07:56:08.713 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/ChangeLog 2024-05-09T07:56:08.716 INFO:tasks.workunit.client.0.smithi087.stdout:blogbench-1.0/COPYING 2024-05-09T07:56:08.718 INFO:tasks.workunit.client.0.smithi087.stderr:+ cd blogbench-1.0/ 2024-05-09T07:56:08.719 INFO:tasks.workunit.client.0.smithi087.stdout:making blogbench 2024-05-09T07:56:08.719 INFO:tasks.workunit.client.0.smithi087.stderr:+ echo 'making blogbench' 2024-05-09T07:56:08.719 INFO:tasks.workunit.client.0.smithi087.stderr:+ ./configure 2024-05-09T07:56:08.833 INFO:tasks.workunit.client.0.smithi087.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-09T07:56:09.845 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether build environment is sane... yes 2024-05-09T07:56:09.863 INFO:tasks.workunit.client.0.smithi087.stdout:checking for gawk... gawk 2024-05-09T07:56:09.886 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether make sets $(MAKE)... yes 2024-05-09T07:56:10.099 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:56:10.102 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:56:10.193 INFO:tasks.workunit.client.0.smithi087.stdout:checking for gcc... gcc 2024-05-09T07:56:10.268 INFO:tasks.workunit.client.0.smithi087.stdout:checking for C compiler default output file name... a.out 2024-05-09T07:56:10.270 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether the C compiler works... yes 2024-05-09T07:56:10.276 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether we are cross compiling... no 2024-05-09T07:56:10.331 INFO:tasks.workunit.client.0.smithi087.stdout:checking for suffix of executables... 2024-05-09T07:56:10.380 INFO:tasks.workunit.client.0.smithi087.stdout:checking for suffix of object files... o 2024-05-09T07:56:10.426 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether we are using the GNU C compiler... yes 2024-05-09T07:56:10.579 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether gcc accepts -g... yes 2024-05-09T07:56:10.580 INFO:tasks.workunit.client.0.smithi087.stdout:checking for gcc option to accept ANSI C... none needed 2024-05-09T07:56:10.598 INFO:tasks.workunit.client.0.smithi087.stdout:checking for style of include used by make... GNU 2024-05-09T07:56:10.790 INFO:tasks.workunit.client.0.smithi087.stdout:checking dependency style of gcc... gcc3 2024-05-09T07:56:10.791 INFO:tasks.workunit.client.0.smithi087.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-05-09T07:56:10.860 INFO:tasks.workunit.client.0.smithi087.stdout:checking how to run the C preprocessor... gcc -E 2024-05-09T07:56:10.916 INFO:tasks.workunit.client.0.smithi087.stdout:checking for egrep... grep -E 2024-05-09T07:56:10.928 INFO:tasks.workunit.client.0.smithi087.stdout:checking for AIX... no 2024-05-09T07:56:11.018 INFO:tasks.workunit.client.0.smithi087.stdout:checking for library containing strerror... none required 2024-05-09T07:56:11.202 INFO:tasks.workunit.client.0.smithi087.stdout:checking for ANSI C header files... yes 2024-05-09T07:56:11.256 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-05-09T07:56:11.318 INFO:tasks.workunit.client.0.smithi087.stdout:checking for sys/types.h... yes 2024-05-09T07:56:11.384 INFO:tasks.workunit.client.0.smithi087.stdout:checking for sys/stat.h... yes 2024-05-09T07:56:11.452 INFO:tasks.workunit.client.0.smithi087.stdout:checking for stdlib.h... yes 2024-05-09T07:56:11.519 INFO:tasks.workunit.client.0.smithi087.stdout:checking for string.h... yes 2024-05-09T07:56:11.585 INFO:tasks.workunit.client.0.smithi087.stdout:checking for memory.h... yes 2024-05-09T07:56:11.651 INFO:tasks.workunit.client.0.smithi087.stdout:checking for strings.h... yes 2024-05-09T07:56:11.722 INFO:tasks.workunit.client.0.smithi087.stdout:checking for inttypes.h... yes 2024-05-09T07:56:11.787 INFO:tasks.workunit.client.0.smithi087.stdout:checking for stdint.h... yes 2024-05-09T07:56:11.855 INFO:tasks.workunit.client.0.smithi087.stdout:checking for unistd.h... yes 2024-05-09T07:56:11.872 INFO:tasks.workunit.client.0.smithi087.stdout:checking for memory.h... (cached) yes 2024-05-09T07:56:11.882 INFO:tasks.workunit.client.0.smithi087.stdout:checking for strings.h... (cached) yes 2024-05-09T07:56:11.892 INFO:tasks.workunit.client.0.smithi087.stdout:checking for unistd.h... (cached) yes 2024-05-09T07:56:11.978 INFO:tasks.workunit.client.0.smithi087.stdout:checking locale.h usability... yes 2024-05-09T07:56:12.003 INFO:tasks.workunit.client.0.smithi087.stdout:checking locale.h presence... yes 2024-05-09T07:56:12.004 INFO:tasks.workunit.client.0.smithi087.stdout:checking for locale.h... yes 2024-05-09T07:56:12.023 INFO:tasks.workunit.client.0.smithi087.stdout:checking for stdlib.h... (cached) yes 2024-05-09T07:56:12.034 INFO:tasks.workunit.client.0.smithi087.stdout:checking for string.h... (cached) yes 2024-05-09T07:56:12.100 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/socket.h usability... yes 2024-05-09T07:56:12.128 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/socket.h presence... yes 2024-05-09T07:56:12.129 INFO:tasks.workunit.client.0.smithi087.stdout:checking for sys/socket.h... yes 2024-05-09T07:56:12.210 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/time.h usability... yes 2024-05-09T07:56:12.235 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/time.h presence... yes 2024-05-09T07:56:12.236 INFO:tasks.workunit.client.0.smithi087.stdout:checking for sys/time.h... yes 2024-05-09T07:56:12.312 INFO:tasks.workunit.client.0.smithi087.stdout:checking fcntl.h usability... yes 2024-05-09T07:56:12.338 INFO:tasks.workunit.client.0.smithi087.stdout:checking fcntl.h presence... yes 2024-05-09T07:56:12.338 INFO:tasks.workunit.client.0.smithi087.stdout:checking for fcntl.h... yes 2024-05-09T07:56:12.409 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/fcntl.h usability... yes 2024-05-09T07:56:12.436 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/fcntl.h presence... yes 2024-05-09T07:56:12.436 INFO:tasks.workunit.client.0.smithi087.stdout:checking for sys/fcntl.h... yes 2024-05-09T07:56:12.527 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/param.h usability... yes 2024-05-09T07:56:12.556 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/param.h presence... yes 2024-05-09T07:56:12.557 INFO:tasks.workunit.client.0.smithi087.stdout:checking for sys/param.h... yes 2024-05-09T07:56:12.620 INFO:tasks.workunit.client.0.smithi087.stdout:checking ioctl.h usability... no 2024-05-09T07:56:12.649 INFO:tasks.workunit.client.0.smithi087.stdout:checking ioctl.h presence... no 2024-05-09T07:56:12.650 INFO:tasks.workunit.client.0.smithi087.stdout:checking for ioctl.h... no 2024-05-09T07:56:12.716 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/ioctl.h usability... yes 2024-05-09T07:56:12.742 INFO:tasks.workunit.client.0.smithi087.stdout:checking sys/ioctl.h presence... yes 2024-05-09T07:56:12.743 INFO:tasks.workunit.client.0.smithi087.stdout:checking for sys/ioctl.h... yes 2024-05-09T07:56:12.807 INFO:tasks.workunit.client.0.smithi087.stdout:checking return type of signal handlers... void 2024-05-09T07:56:12.864 INFO:tasks.workunit.client.0.smithi087.stdout:checking for size_t... yes 2024-05-09T07:56:12.912 INFO:tasks.workunit.client.0.smithi087.stdout:checking for dev_t... yes 2024-05-09T07:56:12.966 INFO:tasks.workunit.client.0.smithi087.stdout:checking for short... yes 2024-05-09T07:56:13.068 INFO:tasks.workunit.client.0.smithi087.stdout:checking size of short... 2 2024-05-09T07:56:13.132 INFO:tasks.workunit.client.0.smithi087.stdout:checking for int... yes 2024-05-09T07:56:13.237 INFO:tasks.workunit.client.0.smithi087.stdout:checking size of int... 4 2024-05-09T07:56:13.300 INFO:tasks.workunit.client.0.smithi087.stdout:checking for long... yes 2024-05-09T07:56:13.391 INFO:tasks.workunit.client.0.smithi087.stdout:checking size of long... 8 2024-05-09T07:56:13.453 INFO:tasks.workunit.client.0.smithi087.stdout:checking for long long... yes 2024-05-09T07:56:13.544 INFO:tasks.workunit.client.0.smithi087.stdout:checking size of long long... 8 2024-05-09T07:56:13.604 INFO:tasks.workunit.client.0.smithi087.stdout:checking for ssize_t... yes 2024-05-09T07:56:13.655 INFO:tasks.workunit.client.0.smithi087.stdout:checking for sig_atomic_t... yes 2024-05-09T07:56:13.713 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether gcc needs -traditional... no 2024-05-09T07:56:13.765 INFO:tasks.workunit.client.0.smithi087.stdout:checking for an ANSI C-conforming const... yes 2024-05-09T07:56:13.808 INFO:tasks.workunit.client.0.smithi087.stdout:checking for inline... inline 2024-05-09T07:56:13.898 INFO:tasks.workunit.client.0.smithi087.stdout:checking for working alloca.h... yes 2024-05-09T07:56:13.967 INFO:tasks.workunit.client.0.smithi087.stdout:checking for alloca... yes 2024-05-09T07:56:14.055 INFO:tasks.workunit.client.0.smithi087.stdout:checking for working memcmp... yes 2024-05-09T07:56:14.136 INFO:tasks.workunit.client.0.smithi087.stdout:checking for strftime... yes 2024-05-09T07:56:14.246 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-05-09T07:56:14.331 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether stat accepts an empty string... no 2024-05-09T07:56:14.414 INFO:tasks.workunit.client.0.smithi087.stdout:checking for vprintf... yes 2024-05-09T07:56:14.494 INFO:tasks.workunit.client.0.smithi087.stdout:checking for _doprnt... no 2024-05-09T07:56:14.525 INFO:tasks.workunit.client.0.smithi087.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-05-09T07:56:14.540 INFO:tasks.workunit.client.0.smithi087.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-05-09T07:56:14.624 INFO:tasks.workunit.client.0.smithi087.stdout:checking for the pthreads library -lpthreads... no 2024-05-09T07:56:14.697 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether pthreads work without any flags... yes 2024-05-09T07:56:14.766 INFO:tasks.workunit.client.0.smithi087.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-05-09T07:56:14.766 INFO:tasks.workunit.client.0.smithi087.stdout:checking if more special flags are required for pthreads... no 2024-05-09T07:56:14.766 INFO:tasks.workunit.client.0.smithi087.stdout:checking for cc_r... gcc 2024-05-09T07:56:14.853 INFO:tasks.workunit.client.0.smithi087.stdout:checking for setrlimit... yes 2024-05-09T07:56:14.934 INFO:tasks.workunit.client.0.smithi087.stdout:checking for setproctitle... no 2024-05-09T07:56:15.018 INFO:tasks.workunit.client.0.smithi087.stdout:checking for getopt_long... yes 2024-05-09T07:56:15.108 INFO:tasks.workunit.client.0.smithi087.stdout:checking for strtoull... yes 2024-05-09T07:56:15.202 INFO:tasks.workunit.client.0.smithi087.stdout:checking for strtoq... yes 2024-05-09T07:56:15.293 INFO:tasks.workunit.client.0.smithi087.stdout:checking for snprintf... yes 2024-05-09T07:56:15.382 INFO:tasks.workunit.client.0.smithi087.stdout:checking for vsnprintf... yes 2024-05-09T07:56:15.470 INFO:tasks.workunit.client.0.smithi087.stdout:checking for vfprintf... yes 2024-05-09T07:56:15.563 INFO:tasks.workunit.client.0.smithi087.stdout:checking for gethostname... yes 2024-05-09T07:56:15.646 INFO:tasks.workunit.client.0.smithi087.stdout:checking for setlocale... yes 2024-05-09T07:56:15.734 INFO:tasks.workunit.client.0.smithi087.stdout:checking for sync... yes 2024-05-09T07:56:15.823 INFO:tasks.workunit.client.0.smithi087.stdout:checking whether snprintf is C99 conformant... done 2024-05-09T07:56:15.839 INFO:tasks.workunit.client.0.smithi087.stdout:configure: creating ./config.status 2024-05-09T07:56:16.086 INFO:tasks.workunit.client.0.smithi087.stdout:config.status: creating Makefile 2024-05-09T07:56:16.115 INFO:tasks.workunit.client.0.smithi087.stdout:config.status: creating src/Makefile 2024-05-09T07:56:16.144 INFO:tasks.workunit.client.0.smithi087.stdout:config.status: creating man/Makefile 2024-05-09T07:56:16.160 INFO:tasks.workunit.client.0.smithi087.stdout:config.status: creating config.h 2024-05-09T07:56:16.243 INFO:tasks.workunit.client.0.smithi087.stdout:config.status: executing depfiles commands 2024-05-09T07:56:16.418 INFO:tasks.workunit.client.0.smithi087.stderr:+ make 2024-05-09T07:56:16.432 INFO:tasks.workunit.client.0.smithi087.stdout:make all-recursive 2024-05-09T07:56:16.438 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-05-09T07:56:16.442 INFO:tasks.workunit.client.0.smithi087.stdout:Making all in src 2024-05-09T07:56:16.464 INFO:tasks.workunit.client.0.smithi087.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-05-09T07:56:16.464 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-05-09T07:56:16.464 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-05-09T07:56:16.557 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-05-09T07:56:16.557 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-05-09T07:56:16.705 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-05-09T07:56:16.705 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-05-09T07:56:16.822 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-05-09T07:56:16.823 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-05-09T07:56:16.941 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-05-09T07:56:16.941 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-05-09T07:56:17.064 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-05-09T07:56:17.064 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-05-09T07:56:17.192 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-05-09T07:56:17.193 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-05-09T07:56:17.333 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-05-09T07:56:17.333 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-05-09T07:56:17.442 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-05-09T07:56:17.443 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-05-09T07:56:17.539 INFO:tasks.workunit.client.0.smithi087.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-05-09T07:56:17.539 INFO:tasks.workunit.client.0.smithi087.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-05-09T07:56:17.622 INFO:tasks.workunit.client.0.smithi087.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-05-09T07:56:17.682 INFO:tasks.workunit.client.0.smithi087.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-05-09T07:56:17.683 INFO:tasks.workunit.client.0.smithi087.stdout:Making all in man 2024-05-09T07:56:17.693 INFO:tasks.workunit.client.0.smithi087.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-05-09T07:56:17.693 INFO:tasks.workunit.client.0.smithi087.stdout:make[2]: Nothing to be done for 'all'. 2024-05-09T07:56:17.693 INFO:tasks.workunit.client.0.smithi087.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-05-09T07:56:17.700 INFO:tasks.workunit.client.0.smithi087.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-05-09T07:56:17.702 INFO:tasks.workunit.client.0.smithi087.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-05-09T07:56:17.703 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-05-09T07:56:17.704 INFO:tasks.workunit.client.0.smithi087.stderr:+ cd src 2024-05-09T07:56:17.705 INFO:tasks.workunit.client.0.smithi087.stderr:+ mkdir blogtest_in 2024-05-09T07:56:17.707 INFO:tasks.workunit.client.0.smithi087.stdout:running blogbench 2024-05-09T07:56:17.708 INFO:tasks.workunit.client.0.smithi087.stderr:+ echo 'running blogbench' 2024-05-09T07:56:17.708 INFO:tasks.workunit.client.0.smithi087.stderr:+ ./blogbench -d blogtest_in 2024-05-09T07:56:17.708 INFO:tasks.workunit.client.0.smithi087.stdout: 2024-05-09T07:56:17.708 INFO:tasks.workunit.client.0.smithi087.stdout:Frequency = 10 secs 2024-05-09T07:56:17.708 INFO:tasks.workunit.client.0.smithi087.stdout:Scratch dir = [blogtest_in] 2024-05-09T07:56:21.276 INFO:tasks.workunit.client.0.smithi087.stdout:Spawning 3 writers... 2024-05-09T07:56:21.277 INFO:tasks.workunit.client.0.smithi087.stdout:Spawning 1 rewriters... 2024-05-09T07:56:21.277 INFO:tasks.workunit.client.0.smithi087.stdout:Spawning 5 commenters... 2024-05-09T07:56:21.277 INFO:tasks.workunit.client.0.smithi087.stdout:Spawning 100 readers... 2024-05-09T07:56:21.279 INFO:tasks.workunit.client.0.smithi087.stdout:Benchmarking for 30 iterations. 2024-05-09T07:56:21.279 INFO:tasks.workunit.client.0.smithi087.stdout:The test will run during 5 minutes. 2024-05-09T07:56:21.279 INFO:tasks.workunit.client.0.smithi087.stdout: 2024-05-09T07:56:21.280 INFO:tasks.workunit.client.0.smithi087.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-05-09T07:56:31.280 INFO:tasks.workunit.client.0.smithi087.stdout: 7 6126 589 2919 248 1485 560 2024-05-09T07:56:40.225 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:56:40.228 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:56:41.280 INFO:tasks.workunit.client.0.smithi087.stdout: 14 4865 395 1107 418 518 670 2024-05-09T07:56:51.280 INFO:tasks.workunit.client.0.smithi087.stdout: 19 3464 329 960 345 441 835 2024-05-09T07:57:01.280 INFO:tasks.workunit.client.0.smithi087.stdout: 22 10838 87 7300 117 4347 215 2024-05-09T07:57:10.470 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:57:10.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:57:11.280 INFO:tasks.workunit.client.0.smithi087.stdout: 23 12699 111 8143 83 3075 130 2024-05-09T07:57:21.281 INFO:tasks.workunit.client.0.smithi087.stdout: 26 11378 224 6573 48 4163 169 2024-05-09T07:57:31.280 INFO:tasks.workunit.client.0.smithi087.stdout: 29 11924 174 6210 83 4358 73 2024-05-09T07:57:40.529 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:57:40.532 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:57:41.280 INFO:tasks.workunit.client.0.smithi087.stdout: 31 12472 185 6546 85 3708 96 2024-05-09T07:57:51.280 INFO:tasks.workunit.client.0.smithi087.stdout: 35 12073 99 6336 112 4243 134 2024-05-09T07:58:01.281 INFO:tasks.workunit.client.0.smithi087.stdout: 35 12100 116 7030 54 4118 96 2024-05-09T07:58:10.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:58:10.598 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:58:11.281 INFO:tasks.workunit.client.0.smithi087.stdout: 36 11451 126 5036 133 4124 196 2024-05-09T07:58:21.288 INFO:tasks.workunit.client.0.smithi087.stdout: 38 11963 63 6511 142 3539 170 2024-05-09T07:58:31.288 INFO:tasks.workunit.client.0.smithi087.stdout: 40 12075 116 6919 71 3506 161 2024-05-09T07:58:41.034 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:58:41.037 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:58:41.288 INFO:tasks.workunit.client.0.smithi087.stdout: 42 11735 133 6145 94 2974 220 2024-05-09T07:58:51.288 INFO:tasks.workunit.client.0.smithi087.stdout: 43 12037 50 6588 138 2845 261 2024-05-09T07:59:01.288 INFO:tasks.workunit.client.0.smithi087.stdout: 45 10777 93 6082 100 4498 277 2024-05-09T07:59:11.288 INFO:tasks.workunit.client.0.smithi087.stdout: 47 11020 100 6329 69 4353 266 2024-05-09T07:59:11.351 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:59:11.357 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:59:21.288 INFO:tasks.workunit.client.0.smithi087.stdout: 48 10783 158 6334 24 4535 263 2024-05-09T07:59:31.288 INFO:tasks.workunit.client.0.smithi087.stdout: 50 10691 90 5386 89 4273 348 2024-05-09T07:59:41.288 INFO:tasks.workunit.client.0.smithi087.stdout: 51 11013 114 6452 63 4542 212 2024-05-09T07:59:41.416 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:59:41.419 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T07:59:41.771 INFO:tasks.ceph.mds.a.smithi087.stderr:2024-05-09T07:59:41.755+0000 7f50f8b43640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 111223) UID: 0 2024-05-09T07:59:51.289 INFO:tasks.workunit.client.0.smithi087.stdout: 52 9881 106 5364 79 4433 128 2024-05-09T08:00:01.289 INFO:tasks.workunit.client.0.smithi087.stdout: 52 10469 94 6053 73 4126 116 2024-05-09T08:00:11.289 INFO:tasks.workunit.client.0.smithi087.stdout: 54 9842 103 5584 59 4348 168 2024-05-09T08:00:21.289 INFO:tasks.workunit.client.0.smithi087.stdout: 55 10025 159 5353 32 4330 180 2024-05-09T08:00:31.289 INFO:tasks.workunit.client.0.smithi087.stdout: 56 9804 111 5348 53 4557 146 2024-05-09T08:00:41.289 INFO:tasks.workunit.client.0.smithi087.stdout: 59 10202 39 5887 77 4569 157 2024-05-09T08:00:51.289 INFO:tasks.workunit.client.0.smithi087.stdout: 59 10321 93 5621 34 3618 187 2024-05-09T08:01:01.289 INFO:tasks.workunit.client.0.smithi087.stdout: 60 10366 77 6173 45 4311 127 2024-05-09T08:01:11.290 INFO:tasks.workunit.client.0.smithi087.stdout: 60 9897 62 5572 35 4959 138 2024-05-09T08:01:21.290 INFO:tasks.workunit.client.0.smithi087.stdout: 62 10790 75 5880 39 3943 105 2024-05-09T08:01:25.746 INFO:tasks.workunit.client.0.smithi087.stdout: 2024-05-09T08:01:25.746 INFO:tasks.workunit.client.0.smithi087.stdout:Final score for writes: 62 2024-05-09T08:01:25.746 INFO:tasks.workunit.client.0.smithi087.stdout:Final score for reads : 5827 2024-05-09T08:01:25.746 INFO:tasks.workunit.client.0.smithi087.stdout: 2024-05-09T08:01:25.746 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T08:01:25.747 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T08:01:55.783 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-05-09T08:01:55.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T08:01:57.029 DEBUG:teuthology.parallel:result is None 2024-05-09T08:01:57.030 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T08:01:57.062 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T08:01:57.062 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-09T08:01:57.072 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T08:01:59.967 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.951+0000 7fb63b488640 1 Processor -- start 2024-05-09T08:01:59.968 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.951+0000 7fb63b488640 1 -- start start 2024-05-09T08:01:59.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb63b488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 0x7fb6340b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:01:59.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb63b488640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb6340b2940 0x7fb634147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:01:59.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb63b488640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6340b6240 con 0x7fb6340b5330 2024-05-09T08:01:59.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb63b488640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb6340b0470 con 0x7fb6340b2940 2024-05-09T08:01:59.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb63b488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340b1580 con 0x7fb6340b5e60 2024-05-09T08:01:59.969 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb638a23640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb6340b5330 0x7fb6340b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34172/0 (socket says 172.21.15.87:34172) 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb638a23640 1 -- 172.21.15.87:0/457423926 learned_addr learned my addr 172.21.15.87:0/457423926 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb639a25640 1 --2- 172.21.15.87:0/457423926 >> v2:172.21.15.110:3300/0 conn(0x7fb6340b2940 0x7fb634147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb639224640 1 --2- 172.21.15.87:0/457423926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 0x7fb6340b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb62bfff640 1 -- 172.21.15.87:0/457423926 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171988697 0 0) 0x7fb6340b6240 con 0x7fb6340b5330 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb62bfff640 1 -- 172.21.15.87:0/457423926 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb620005730 con 0x7fb6340b5330 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb639224640 1 -- 172.21.15.87:0/457423926 >> v2:172.21.15.110:3300/0 conn(0x7fb6340b2940 msgr2=0x7fb634147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb639224640 1 --2- 172.21.15.87:0/457423926 >> v2:172.21.15.110:3300/0 conn(0x7fb6340b2940 0x7fb634147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.952+0000 7fb639224640 1 -- 172.21.15.87:0/457423926 >> v1:172.21.15.87:6789/0 conn(0x7fb6340b5330 legacy=0x7fb6340b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.953+0000 7fb639224640 1 -- 172.21.15.87:0/457423926 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6340b1860 con 0x7fb6340b5e60 2024-05-09T08:01:59.970 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.953+0000 7fb639a25640 1 --2- 172.21.15.87:0/457423926 >> v2:172.21.15.110:3300/0 conn(0x7fb6340b2940 0x7fb634147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:01:59.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.953+0000 7fb639224640 1 --2- 172.21.15.87:0/457423926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 0x7fb6340b1cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb630009d90 tx=0x7fb63002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=269ffad48799e9d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:01:59.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb62bfff640 1 -- 172.21.15.87:0/457423926 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630031600 con 0x7fb6340b5e60 2024-05-09T08:01:59.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb62bfff640 1 -- 172.21.15.87:0/457423926 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6300317a0 con 0x7fb6340b5e60 2024-05-09T08:01:59.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb62bfff640 1 -- 172.21.15.87:0/457423926 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630031b70 con 0x7fb6340b5e60 2024-05-09T08:01:59.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb63b488640 1 -- 172.21.15.87:0/457423926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 msgr2=0x7fb6340b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:01:59.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb63b488640 1 --2- 172.21.15.87:0/457423926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 0x7fb6340b1cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb630009d90 tx=0x7fb63002a5d0 comp rx=0 tx=0).stop 2024-05-09T08:01:59.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb63b488640 1 -- 172.21.15.87:0/457423926 shutdown_connections 2024-05-09T08:01:59.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb63b488640 1 --2- 172.21.15.87:0/457423926 >> v2:172.21.15.110:3300/0 conn(0x7fb6340b2940 0x7fb634147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:01:59.972 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb63b488640 1 --2- 172.21.15.87:0/457423926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 0x7fb6340b1cf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:01:59.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb63b488640 1 -- 172.21.15.87:0/457423926 >> 172.21.15.87:0/457423926 conn(0x7fb63406c6a0 msgr2=0x7fb63406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:01:59.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb63b488640 1 -- 172.21.15.87:0/457423926 shutdown_connections 2024-05-09T08:01:59.973 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.954+0000 7fb63b488640 1 -- 172.21.15.87:0/457423926 wait complete. 2024-05-09T08:01:59.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.956+0000 7fb63b488640 1 Processor -- start 2024-05-09T08:01:59.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.956+0000 7fb63b488640 1 -- start start 2024-05-09T08:01:59.975 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb63b488640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6340b2940 0x7fb6341cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb63b488640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6340b5330 0x7fb6341ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb63b488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 0x7fb6341cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb63b488640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340afae0 con 0x7fb6340b5330 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb63b488640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340af960 con 0x7fb6340b2940 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb63b488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb634148110 con 0x7fb6340b5e60 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb638a23640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6340b5330 0x7fb6341ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb638a23640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6340b5330 0x7fb6341ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51460/0 (socket says 172.21.15.87:51460) 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb638a23640 1 -- 172.21.15.87:0/872893115 learned_addr learned my addr 172.21.15.87:0/872893115 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb639224640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6340b2940 0x7fb6341cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb639a25640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 0x7fb6341cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:01:59.976 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb638a23640 1 -- 172.21.15.87:0/872893115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 msgr2=0x7fb6341cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb638a23640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 0x7fb6341cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb638a23640 1 -- 172.21.15.87:0/872893115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6340b2940 msgr2=0x7fb6341cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb638a23640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6340b2940 0x7fb6341cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb638a23640 1 -- 172.21.15.87:0/872893115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6340b6fe0 con 0x7fb6340b5330 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.957+0000 7fb638a23640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6340b5330 0x7fb6341ce370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb62400c430 tx=0x7fb62400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.958+0000 7fb629ffb640 1 -- 172.21.15.87:0/872893115 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb624017070 con 0x7fb6340b5330 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.958+0000 7fb629ffb640 1 -- 172.21.15.87:0/872893115 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb624005ce0 con 0x7fb6340b5330 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.958+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6341d88e0 con 0x7fb6340b5330 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.958+0000 7fb629ffb640 1 -- 172.21.15.87:0/872893115 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6240072f0 con 0x7fb6340b5330 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.958+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63413e040 con 0x7fb6340b5330 2024-05-09T08:01:59.977 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.959+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6340691f0 con 0x7fb6340b5330 2024-05-09T08:01:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.959+0000 7fb629ffb640 1 -- 172.21.15.87:0/872893115 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb62401a070 con 0x7fb6340b5330 2024-05-09T08:01:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.960+0000 7fb629ffb640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb61806be30 0x7fb61806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:01:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.960+0000 7fb639224640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb61806be30 0x7fb61806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:01:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.960+0000 7fb629ffb640 1 -- 172.21.15.87:0/872893115 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fb62408a1b0 con 0x7fb6340b5330 2024-05-09T08:01:59.978 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.961+0000 7fb639224640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb61806be30 0x7fb61806e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb630009d90 tx=0x7fb63002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:01:59.981 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:01:59.965+0000 7fb629ffb640 1 -- 172.21.15.87:0/872893115 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb6340b6fe0 con 0x7fb6340b5330 2024-05-09T08:02:00.166 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.149+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb63406bbe0 con 0x7fb6340b5330 2024-05-09T08:02:00.167 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.150+0000 7fb629ffb640 1 -- 172.21.15.87:0/872893115 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16820 (secure 0 0 0) 0x7fb624058510 con 0x7fb6340b5330 2024-05-09T08:02:00.167 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:00.168 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:55:18.551072+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb61806be30 msgr2=0x7fb61806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb61806be30 0x7fb61806e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb630009d90 tx=0x7fb63002f000 comp rx=0 tx=0).stop 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6340b5330 msgr2=0x7fb6341ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6340b5330 0x7fb6341ce370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb62400c430 tx=0x7fb62400c830 comp rx=0 tx=0).stop 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 shutdown_connections 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb61806be30 0x7fb61806e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6340b5e60 0x7fb6341cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb6340b5330 0x7fb6341ce370 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 --2- 172.21.15.87:0/872893115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6340b2940 0x7fb6341cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 >> 172.21.15.87:0/872893115 conn(0x7fb63406c6a0 msgr2=0x7fb6340b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 shutdown_connections 2024-05-09T08:02:00.170 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.152+0000 7fb63b488640 1 -- 172.21.15.87:0/872893115 wait complete. 2024-05-09T08:02:00.181 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T07:54:24.920922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T07:54:34.879628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T07:54:35.405648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T08:02:00.182 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T08:02:00.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.268+0000 7f1a71963640 1 Processor -- start 2024-05-09T08:02:00.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.268+0000 7f1a71963640 1 -- start start 2024-05-09T08:02:00.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.269+0000 7f1a71963640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a6c0b39d0 0x7f1a6c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.269+0000 7f1a71963640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1a6c148350 0x7f1a6c14f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.269+0000 7f1a71963640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a6c0b15a0 con 0x7f1a6c0ae2c0 2024-05-09T08:02:00.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.269+0000 7f1a71963640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6c0ae720 con 0x7f1a6c0b39d0 2024-05-09T08:02:00.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.269+0000 7f1a71963640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6c0b3db0 con 0x7f1a6c148350 2024-05-09T08:02:00.295 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.269+0000 7f1a6affd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1a6c0b39d0 0x7f1a6c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.269+0000 7f1a6a7fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1a6c0ae2c0 0x7f1a6c147c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34182/0 (socket says 172.21.15.87:34182) 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.269+0000 7f1a6a7fc640 1 -- 172.21.15.87:0/3270697345 learned_addr learned my addr 172.21.15.87:0/3270697345 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.269+0000 7f1a6b7fe640 1 --2- 172.21.15.87:0/3270697345 >> v2:172.21.15.110:3300/0 conn(0x7f1a6c148350 0x7f1a6c14f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.270+0000 7f1a6affd640 1 -- 172.21.15.87:0/3270697345 >> v2:172.21.15.110:3300/0 conn(0x7f1a6c148350 msgr2=0x7f1a6c14f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.270+0000 7f1a6affd640 1 --2- 172.21.15.87:0/3270697345 >> v2:172.21.15.110:3300/0 conn(0x7f1a6c148350 0x7f1a6c14f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.270+0000 7f1a6affd640 1 -- 172.21.15.87:0/3270697345 >> v1:172.21.15.87:6789/0 conn(0x7f1a6c0ae2c0 legacy=0x7f1a6c147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.270+0000 7f1a69ffb640 1 -- 172.21.15.87:0/3270697345 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496317315 0 0) 0x7f1a6c0b15a0 con 0x7f1a6c0ae2c0 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.270+0000 7f1a6affd640 1 -- 172.21.15.87:0/3270697345 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c0af940 con 0x7f1a6c0b39d0 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.270+0000 7f1a6affd640 1 --2- 172.21.15.87:0/3270697345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c0b39d0 0x7f1a6c0add80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0b6c10 tx=0x7f1a5c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e947e08b395ebe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:00.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.270+0000 7f1a69ffb640 1 -- 172.21.15.87:0/3270697345 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c007740 con 0x7f1a6c0b39d0 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a69ffb640 1 -- 172.21.15.87:0/3270697345 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0078e0 con 0x7f1a6c0b39d0 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a69ffb640 1 -- 172.21.15.87:0/3270697345 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c007cb0 con 0x7f1a6c0b39d0 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a71963640 1 -- 172.21.15.87:0/3270697345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c0b39d0 msgr2=0x7f1a6c0add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a71963640 1 --2- 172.21.15.87:0/3270697345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c0b39d0 0x7f1a6c0add80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0b6c10 tx=0x7f1a5c02a5f0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a71963640 1 -- 172.21.15.87:0/3270697345 shutdown_connections 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a71963640 1 --2- 172.21.15.87:0/3270697345 >> v2:172.21.15.110:3300/0 conn(0x7f1a6c148350 0x7f1a6c14f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a71963640 1 --2- 172.21.15.87:0/3270697345 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c0b39d0 0x7f1a6c0add80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a71963640 1 -- 172.21.15.87:0/3270697345 >> 172.21.15.87:0/3270697345 conn(0x7f1a6c0b5860 msgr2=0x7f1a6c0b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a71963640 1 -- 172.21.15.87:0/3270697345 shutdown_connections 2024-05-09T08:02:00.297 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.271+0000 7f1a71963640 1 -- 172.21.15.87:0/3270697345 wait complete. 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.272+0000 7f1a71963640 1 Processor -- start 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.272+0000 7f1a71963640 1 -- start start 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a71963640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a6c0ae2c0 0x7f1a6c1420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a71963640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a6c0b39d0 0x7f1a6c143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a71963640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c148350 0x7f1a6c13f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a71963640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0b5280 con 0x7f1a6c148350 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a71963640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0b5100 con 0x7f1a6c0b39d0 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a71963640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c06d830 con 0x7f1a6c0ae2c0 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c148350 0x7f1a6c13f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6b7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c148350 0x7f1a6c13f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51476/0 (socket says 172.21.15.87:51476) 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6b7fe640 1 -- 172.21.15.87:0/1893924876 learned_addr learned my addr 172.21.15.87:0/1893924876 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6affd640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a6c0ae2c0 0x7f1a6c1420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6a7fc640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a6c0b39d0 0x7f1a6c143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6b7fe640 1 -- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a6c0ae2c0 msgr2=0x7f1a6c1420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6b7fe640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a6c0ae2c0 0x7f1a6c1420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6b7fe640 1 -- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a6c0b39d0 msgr2=0x7f1a6c143720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6b7fe640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a6c0b39d0 0x7f1a6c143720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6b7fe640 1 -- 172.21.15.87:0/1893924876 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c141e30 con 0x7f1a6c148350 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6affd640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a6c0ae2c0 0x7f1a6c1420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6a7fc640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a6c0b39d0 0x7f1a6c143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.273+0000 7f1a6b7fe640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c148350 0x7f1a6c13f470 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400e930 tx=0x7f1a6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.274+0000 7f1a53fff640 1 -- 172.21.15.87:0/1893924876 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64017070 con 0x7f1a6c148350 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.274+0000 7f1a53fff640 1 -- 172.21.15.87:0/1893924876 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6400c980 con 0x7f1a6c148350 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.274+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c144ce0 con 0x7f1a6c148350 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.274+0000 7f1a53fff640 1 -- 172.21.15.87:0/1893924876 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6400cd70 con 0x7f1a6c148350 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.274+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c1dd1b0 con 0x7f1a6c148350 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.275+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6c1dccd0 con 0x7f1a6c148350 2024-05-09T08:02:00.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.275+0000 7f1a53fff640 1 -- 172.21.15.87:0/1893924876 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a6401a070 con 0x7f1a6c148350 2024-05-09T08:02:00.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.276+0000 7f1a53fff640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a5806be30 0x7f1a5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.276+0000 7f1a53fff640 1 -- 172.21.15.87:0/1893924876 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f1a6408ae70 con 0x7f1a6c148350 2024-05-09T08:02:00.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.276+0000 7f1a6affd640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a5806be30 0x7f1a5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.300 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.276+0000 7f1a6affd640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a5806be30 0x7f1a5806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c034000 tx=0x7f1a5c033040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:00.325 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.307+0000 7f1a53fff640 1 -- 172.21.15.87:0/1893924876 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1a640598e0 con 0x7f1a6c148350 2024-05-09T08:02:00.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.483+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a6c068650 con 0x7f1a6c148350 2024-05-09T08:02:00.501 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.484+0000 7f1a53fff640 1 -- 172.21.15.87:0/1893924876 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f1a640591e0 con 0x7f1a6c148350 2024-05-09T08:02:00.501 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-09T08:02:00.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.486+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a5806be30 msgr2=0x7f1a5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.504 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.486+0000 7f1a71963640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a5806be30 0x7f1a5806e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c034000 tx=0x7f1a5c033040 comp rx=0 tx=0).stop 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.486+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c148350 msgr2=0x7f1a6c13f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.486+0000 7f1a71963640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c148350 0x7f1a6c13f470 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a6400e930 tx=0x7f1a6400edf0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.487+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 shutdown_connections 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.487+0000 7f1a71963640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f1a5806be30 0x7f1a5806e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.487+0000 7f1a71963640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1a6c148350 0x7f1a6c13f470 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.487+0000 7f1a71963640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a6c0b39d0 0x7f1a6c143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.487+0000 7f1a71963640 1 --2- 172.21.15.87:0/1893924876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a6c0ae2c0 0x7f1a6c1420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.487+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 >> 172.21.15.87:0/1893924876 conn(0x7f1a6c0b5860 msgr2=0x7f1a6c071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.487+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 shutdown_connections 2024-05-09T08:02:00.505 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.487+0000 7f1a71963640 1 -- 172.21.15.87:0/1893924876 wait complete. 2024-05-09T08:02:00.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T08:02:00.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.605+0000 7f2ce50c4640 1 Processor -- start 2024-05-09T08:02:00.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.605+0000 7f2ce50c4640 1 -- start start 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2ce50c4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ce00ae490 0x7f2ce0146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2ce50c4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce00b15a0 con 0x7f2ce00b39d0 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2ce50c4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce00b3db0 con 0x7f2ce0147100 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2ce50c4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce00af940 con 0x7f2ce00ae490 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cded9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f2ce00b39d0 0x7f2ce00add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34196/0 (socket says 172.21.15.87:34196) 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cded9d640 1 -- 172.21.15.87:0/502971454 learned_addr learned my addr 172.21.15.87:0/502971454 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cde59c640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ce00ae490 0x7f2ce0146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970141897 0 0) 0x7f2ce00b15a0 con 0x7f2ce00b39d0 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ccc003520 con 0x7f2ce00b39d0 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2996929312 0 0) 0x7f2ccc003520 con 0x7f2ce00b39d0 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ce00ae490 msgr2=0x7f2ce0146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ce00ae490 0x7f2ce0146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.627 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 >> v1:172.21.15.110:6789/0 conn(0x7f2ce0147100 legacy=0x7f2ce014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce00afd90 con 0x7f2ce00b39d0 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f2cd80019f0 con 0x7f2ce00b39d0 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 >> v1:172.21.15.87:6789/0 conn(0x7f2ce00b39d0 legacy=0x7f2ce00add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc0039e0 0x7f2ccc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ccc004390 0x7f2ccc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ce00ae490 0x7f2ccc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce00af940 con 0x7f2ccc004390 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc00ba70 con 0x7f2ccc0039e0 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2ccc00bc70 con 0x7f2ce00ae490 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.606+0000 7f2cde59c640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ccc004390 0x7f2ccc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.607+0000 7f2cded9d640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc0039e0 0x7f2ccc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.607+0000 7f2cdf59e640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ce00ae490 0x7f2ccc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.607+0000 7f2cde59c640 1 -- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ce00ae490 msgr2=0x7f2ccc005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.607+0000 7f2cde59c640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ce00ae490 0x7f2ccc005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.607+0000 7f2cde59c640 1 -- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc0039e0 msgr2=0x7f2ccc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.607+0000 7f2cde59c640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ccc0039e0 0x7f2ccc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.607+0000 7f2cde59c640 1 -- 172.21.15.87:0/502971454 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc003520 con 0x7f2ccc004390 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.607+0000 7f2cdf59e640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ce00ae490 0x7f2ccc005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.607+0000 7f2cde59c640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ccc004390 0x7f2ccc004860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009a70 tx=0x7f2ccc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f17275ed5fd126 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8036070 con 0x7f2ccc004390 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc8031400 con 0x7f2ccc004390 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2cddd9b640 1 -- 172.21.15.87:0/502971454 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8009670 con 0x7f2ccc004390 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2ce50c4640 1 -- 172.21.15.87:0/502971454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ccc004390 msgr2=0x7f2ccc004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2ce50c4640 1 --2- 172.21.15.87:0/502971454 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ccc004390 0x7f2ccc004860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009a70 tx=0x7f2ccc005830 comp rx=0 tx=0).stop 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2cdf59e640 1 -- 172.21.15.87:0/502971454 reap_dead start 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2ce50c4640 1 -- 172.21.15.87:0/502971454 shutdown_connections 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2ce50c4640 1 -- 172.21.15.87:0/502971454 >> 172.21.15.87:0/502971454 conn(0x7f2ce00b5860 msgr2=0x7f2ce00b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2ce50c4640 1 -- 172.21.15.87:0/502971454 shutdown_connections 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.608+0000 7f2ce50c4640 1 -- 172.21.15.87:0/502971454 wait complete. 2024-05-09T08:02:00.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.609+0000 7f2ce50c4640 1 Processor -- start 2024-05-09T08:02:00.630 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.609+0000 7f2ce50c4640 1 -- start start 2024-05-09T08:02:00.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2ce50c4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ccc004390 0x7f2ce01ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2ce50c4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ce01cda70 0x7f2ce0071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2ce50c4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce013ef20 0x7f2ce013f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2ce50c4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce0146d40 con 0x7f2ce013ef20 2024-05-09T08:02:00.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2ce50c4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce0146bc0 con 0x7f2ce01cda70 2024-05-09T08:02:00.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2ce50c4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce0146ec0 con 0x7f2ccc004390 2024-05-09T08:02:00.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cdf59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce013ef20 0x7f2ce013f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.632 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cdf59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce013ef20 0x7f2ce013f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51490/0 (socket says 172.21.15.87:51490) 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cdf59e640 1 -- 172.21.15.87:0/1539938145 learned_addr learned my addr 172.21.15.87:0/1539938145 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cde59c640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ce01cda70 0x7f2ce0071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cded9d640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ccc004390 0x7f2ce01ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cdf59e640 1 -- 172.21.15.87:0/1539938145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ccc004390 msgr2=0x7f2ce01ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cdf59e640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ccc004390 0x7f2ce01ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cdf59e640 1 -- 172.21.15.87:0/1539938145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ce01cda70 msgr2=0x7f2ce0071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cdf59e640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ce01cda70 0x7f2ce0071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.610+0000 7f2cdf59e640 1 -- 172.21.15.87:0/1539938145 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce01ce2a0 con 0x7f2ce013ef20 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.611+0000 7f2cdf59e640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce013ef20 0x7f2ce013f3a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ce01474e0 tx=0x7f2cd000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.611+0000 7f2cd77fe640 1 -- 172.21.15.87:0/1539938145 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0019070 con 0x7f2ce013ef20 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.611+0000 7f2cd77fe640 1 -- 172.21.15.87:0/1539938145 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd00052e0 con 0x7f2ce013ef20 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.611+0000 7f2cd77fe640 1 -- 172.21.15.87:0/1539938145 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0003850 con 0x7f2ce013ef20 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.611+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce01ce580 con 0x7f2ce013ef20 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.611+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce009eb90 con 0x7f2ce013ef20 2024-05-09T08:02:00.633 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.612+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce01cc4d0 con 0x7f2ce013ef20 2024-05-09T08:02:00.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.612+0000 7f2cd77fe640 1 -- 172.21.15.87:0/1539938145 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cd001c070 con 0x7f2ce013ef20 2024-05-09T08:02:00.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.613+0000 7f2cd77fe640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2cc006be30 0x7f2cc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.613+0000 7f2cd77fe640 1 -- 172.21.15.87:0/1539938145 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f2cd008a2e0 con 0x7f2ce013ef20 2024-05-09T08:02:00.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.613+0000 7f2cded9d640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2cc006be30 0x7f2cc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.613+0000 7f2cded9d640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2cc006be30 0x7f2cc006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0142050 tx=0x7f2cd8001fb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:00.634 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.617+0000 7f2cd77fe640 1 -- 172.21.15.87:0/1539938145 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2cd0058640 con 0x7f2ce013ef20 2024-05-09T08:02:00.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.792+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2ce006bc70 con 0x7f2ce013ef20 2024-05-09T08:02:00.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.792+0000 7f2cd77fe640 1 -- 172.21.15.87:0/1539938145 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f2cd005c940 con 0x7f2ce013ef20 2024-05-09T08:02:00.810 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-05-09T08:02:00.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2cc006be30 msgr2=0x7f2cc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2cc006be30 0x7f2cc006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0142050 tx=0x7f2cd8001fb0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce013ef20 msgr2=0x7f2ce013f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce013ef20 0x7f2ce013f3a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ce01474e0 tx=0x7f2cd000e890 comp rx=0 tx=0).stop 2024-05-09T08:02:00.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 shutdown_connections 2024-05-09T08:02:00.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2cc006be30 0x7f2cc006e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ce013ef20 0x7f2ce013f3a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ce01cda70 0x7f2ce0071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 --2- 172.21.15.87:0/1539938145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ccc004390 0x7f2ce01ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 >> 172.21.15.87:0/1539938145 conn(0x7f2ce00b5860 msgr2=0x7f2ce00b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 shutdown_connections 2024-05-09T08:02:00.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.794+0000 7f2ce50c4640 1 -- 172.21.15.87:0/1539938145 wait complete. 2024-05-09T08:02:00.824 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T08:02:00.927 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.909+0000 7fc1dddf4640 1 Processor -- start 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.909+0000 7fc1dddf4640 1 -- start start 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.909+0000 7fc1dddf4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1d8072be0 0x7fc1d80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.909+0000 7fc1dddf4640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d80b11d0 con 0x7fc1d8149330 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.909+0000 7fc1dddf4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d80b2640 con 0x7fc1d806d630 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.909+0000 7fc1dddf4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc1d8072fc0 con 0x7fc1d8072be0 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.910+0000 7fc1d77fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1d8072be0 0x7fc1d80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.910+0000 7fc1d7fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc1d8149330 0x7fc1d814ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:34198/0 (socket says 172.21.15.87:34198) 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.910+0000 7fc1d7fff640 1 -- 172.21.15.87:0/3812791663 learned_addr learned my addr 172.21.15.87:0/3812791663 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.910+0000 7fc1d77fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc1d8072be0 0x7fc1d80b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51496/0 (socket says 172.21.15.87:51496) 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.910+0000 7fc1d77fe640 1 -- 172.21.15.87:0/3812791663 >> v1:172.21.15.110:6789/0 conn(0x7fc1d806d630 legacy=0x7fc1d8148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.910+0000 7fc1d77fe640 1 -- 172.21.15.87:0/3812791663 >> v1:172.21.15.87:6789/0 conn(0x7fc1d8149330 legacy=0x7fc1d814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.910+0000 7fc1d67fc640 1 -- 172.21.15.87:0/3812791663 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383585362 0 0) 0x7fc1d80b11d0 con 0x7fc1d8149330 2024-05-09T08:02:00.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.910+0000 7fc1d77fe640 1 -- 172.21.15.87:0/3812791663 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d80b2920 con 0x7fc1d8072be0 2024-05-09T08:02:00.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1d77fe640 1 --2- 172.21.15.87:0/3812791663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d8072be0 0x7fc1d80b0950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80097a0 tx=0x7fc1c802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e336e976475a994f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:00.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1d67fc640 1 -- 172.21.15.87:0/3812791663 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8037070 con 0x7fc1d8072be0 2024-05-09T08:02:00.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1d67fc640 1 -- 172.21.15.87:0/3812791663 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c802adc0 con 0x7fc1d8072be0 2024-05-09T08:02:00.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1d67fc640 1 -- 172.21.15.87:0/3812791663 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8032660 con 0x7fc1d8072be0 2024-05-09T08:02:00.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1dddf4640 1 -- 172.21.15.87:0/3812791663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d8072be0 msgr2=0x7fc1d80b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1dddf4640 1 --2- 172.21.15.87:0/3812791663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d8072be0 0x7fc1d80b0950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80097a0 tx=0x7fc1c802a0b0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1dddf4640 1 -- 172.21.15.87:0/3812791663 shutdown_connections 2024-05-09T08:02:00.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1dddf4640 1 --2- 172.21.15.87:0/3812791663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d8072be0 0x7fc1d80b0950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.930 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1dddf4640 1 -- 172.21.15.87:0/3812791663 >> 172.21.15.87:0/3812791663 conn(0x7fc1d80b5860 msgr2=0x7fc1d80b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:00.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1dddf4640 1 -- 172.21.15.87:0/3812791663 shutdown_connections 2024-05-09T08:02:00.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.911+0000 7fc1dddf4640 1 -- 172.21.15.87:0/3812791663 wait complete. 2024-05-09T08:02:00.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.912+0000 7fc1dddf4640 1 Processor -- start 2024-05-09T08:02:00.931 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.912+0000 7fc1dddf4640 1 -- start start 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1dddf4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d806d630 0x7fc1d8144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1dddf4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d8072be0 0x7fc1d81deb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1dddf4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d8149330 0x7fc1d806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1dddf4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d80b22a0 con 0x7fc1d806d630 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1dddf4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d80b1860 con 0x7fc1d8149330 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1dddf4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc1d80b2420 con 0x7fc1d8072be0 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1d77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d806d630 0x7fc1d8144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1d77fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d806d630 0x7fc1d8144d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51498/0 (socket says 172.21.15.87:51498) 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1d77fe640 1 -- 172.21.15.87:0/2433425258 learned_addr learned my addr 172.21.15.87:0/2433425258 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1d7fff640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d8149330 0x7fc1d806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1d77fe640 1 -- 172.21.15.87:0/2433425258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d8072be0 msgr2=0x7fc1d81deb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.933 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1d77fe640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d8072be0 0x7fc1d81deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1d77fe640 1 -- 172.21.15.87:0/2433425258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d8149330 msgr2=0x7fc1d806fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1d77fe640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d8149330 0x7fc1d806fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.913+0000 7fc1d77fe640 1 -- 172.21.15.87:0/2433425258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d8070750 con 0x7fc1d806d630 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.914+0000 7fc1d77fe640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d806d630 0x7fc1d8144d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80097a0 tx=0x7fc1c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.914+0000 7fc1bffff640 1 -- 172.21.15.87:0/2433425258 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8041070 con 0x7fc1d806d630 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.914+0000 7fc1bffff640 1 -- 172.21.15.87:0/2433425258 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c803c670 con 0x7fc1d806d630 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.914+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d8141a60 con 0x7fc1d806d630 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.914+0000 7fc1bffff640 1 -- 172.21.15.87:0/2433425258 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c8037040 con 0x7fc1d806d630 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.914+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d81df040 con 0x7fc1d806d630 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.915+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d81421a0 con 0x7fc1d806d630 2024-05-09T08:02:00.934 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.915+0000 7fc1bffff640 1 -- 172.21.15.87:0/2433425258 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc1c8044070 con 0x7fc1d806d630 2024-05-09T08:02:00.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.916+0000 7fc1bffff640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc1c406be30 0x7fc1c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:00.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.916+0000 7fc1d6ffd640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc1c406be30 0x7fc1c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:00.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.916+0000 7fc1bffff640 1 -- 172.21.15.87:0/2433425258 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fc1c80ab730 con 0x7fc1d806d630 2024-05-09T08:02:00.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.916+0000 7fc1d6ffd640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc1c406be30 0x7fc1c406e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1d81454c0 tx=0x7fc1cc0079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:00.937 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:00.920+0000 7fc1bffff640 1 -- 172.21.15.87:0/2433425258 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc1c807a0e0 con 0x7fc1d806d630 2024-05-09T08:02:01.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.096+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc1d80691f0 con 0x7fc1d806d630 2024-05-09T08:02:01.114 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.097+0000 7fc1bffff640 1 -- 172.21.15.87:0/2433425258 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fc1c80799e0 con 0x7fc1d806d630 2024-05-09T08:02:01.115 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc1c406be30 msgr2=0x7fc1c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc1c406be30 0x7fc1c406e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1d81454c0 tx=0x7fc1cc0079b0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d806d630 msgr2=0x7fc1d8144d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d806d630 0x7fc1d8144d20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80097a0 tx=0x7fc1c80046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 shutdown_connections 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc1c406be30 0x7fc1c406e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d8072be0 0x7fc1d81deb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d8149330 0x7fc1d806fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 --2- 172.21.15.87:0/2433425258 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc1d806d630 0x7fc1d8144d20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 >> 172.21.15.87:0/2433425258 conn(0x7fc1d80b5860 msgr2=0x7fc1d80b8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 shutdown_connections 2024-05-09T08:02:01.117 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.099+0000 7fc1dddf4640 1 -- 172.21.15.87:0/2433425258 wait complete. 2024-05-09T08:02:01.128 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-09T08:02:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.210+0000 7effd72ba640 1 Processor -- start 2024-05-09T08:02:01.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.210+0000 7effd72ba640 1 -- start start 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd72ba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7effd00b5e20 0x7effd0147720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd72ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b3e30 0x7effd0141580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd72ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7effd0141ac0 0x7effd00b7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd72ba640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7effd00b50c0 con 0x7effd00b5e20 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd72ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7effd00b5900 con 0x7effd0141ac0 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd72ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7effd00b4a70 con 0x7effd00b3e30 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd5056640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7effd00b5e20 0x7effd0147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd5056640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7effd00b5e20 0x7effd0147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51502/0 (socket says 172.21.15.87:51502) 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd5056640 1 -- 172.21.15.87:0/3648387190 learned_addr learned my addr 172.21.15.87:0/3648387190 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:01.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd5857640 1 --2- 172.21.15.87:0/3648387190 >> v2:172.21.15.110:3300/0 conn(0x7effd0141ac0 0x7effd00b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.211+0000 7effd4855640 1 --2- 172.21.15.87:0/3648387190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b3e30 0x7effd0141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.212+0000 7effd5056640 1 -- 172.21.15.87:0/3648387190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b3e30 msgr2=0x7effd0141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.212+0000 7effd5056640 1 --2- 172.21.15.87:0/3648387190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b3e30 0x7effd0141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.212+0000 7effd5056640 1 -- 172.21.15.87:0/3648387190 >> v2:172.21.15.110:3300/0 conn(0x7effd0141ac0 msgr2=0x7effd00b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.212+0000 7effd5056640 1 --2- 172.21.15.87:0/3648387190 >> v2:172.21.15.110:3300/0 conn(0x7effd0141ac0 0x7effd00b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.212+0000 7effd5056640 1 -- 172.21.15.87:0/3648387190 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd00b4d50 con 0x7effd00b5e20 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.212+0000 7effd5056640 1 --2- 172.21.15.87:0/3648387190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b5e20 0x7effd0147720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7effd0145330 tx=0x7effcc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f339aca6d3cf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.212+0000 7effc7fff640 1 -- 172.21.15.87:0/3648387190 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc004030 con 0x7effd00b5e20 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.212+0000 7effc7fff640 1 -- 172.21.15.87:0/3648387190 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effcc0041d0 con 0x7effd00b5e20 2024-05-09T08:02:01.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.212+0000 7effc7fff640 1 -- 172.21.15.87:0/3648387190 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc003610 con 0x7effd00b5e20 2024-05-09T08:02:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.213+0000 7effd72ba640 1 -- 172.21.15.87:0/3648387190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b5e20 msgr2=0x7effd0147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.213+0000 7effd72ba640 1 --2- 172.21.15.87:0/3648387190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b5e20 0x7effd0147720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7effd0145330 tx=0x7effcc02a1c0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.213+0000 7effd72ba640 1 -- 172.21.15.87:0/3648387190 shutdown_connections 2024-05-09T08:02:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.213+0000 7effd72ba640 1 --2- 172.21.15.87:0/3648387190 >> v2:172.21.15.110:3300/0 conn(0x7effd0141ac0 0x7effd00b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.213+0000 7effd72ba640 1 --2- 172.21.15.87:0/3648387190 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b3e30 0x7effd0141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.213+0000 7effd72ba640 1 --2- 172.21.15.87:0/3648387190 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b5e20 0x7effd0147720 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.213+0000 7effd72ba640 1 -- 172.21.15.87:0/3648387190 >> 172.21.15.87:0/3648387190 conn(0x7effd00676a0 msgr2=0x7effd00bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.213+0000 7effd72ba640 1 -- 172.21.15.87:0/3648387190 shutdown_connections 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.213+0000 7effd72ba640 1 -- 172.21.15.87:0/3648387190 wait complete. 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.214+0000 7effd72ba640 1 Processor -- start 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.214+0000 7effd72ba640 1 -- start start 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd72ba640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b3e30 0x7effd0144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd72ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b5e20 0x7effd01e0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd72ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd0141ac0 0x7effd01e0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd72ba640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7effd00b5550 con 0x7effd00b3e30 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd72ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7effd00bdbc0 con 0x7effd0141ac0 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd72ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7effd0143b00 con 0x7effd00b5e20 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5056640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b3e30 0x7effd0144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5056640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b3e30 0x7effd0144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:51506/0 (socket says 172.21.15.87:51506) 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5056640 1 -- 172.21.15.87:0/1939058885 learned_addr learned my addr 172.21.15.87:0/1939058885 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5857640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd0141ac0 0x7effd01e0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:01.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd4855640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b5e20 0x7effd01e0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5056640 1 -- 172.21.15.87:0/1939058885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b5e20 msgr2=0x7effd01e0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5056640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b5e20 0x7effd01e0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5056640 1 -- 172.21.15.87:0/1939058885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd0141ac0 msgr2=0x7effd01e0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5056640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd0141ac0 0x7effd01e0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5056640 1 -- 172.21.15.87:0/1939058885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd0144fb0 con 0x7effd00b3e30 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd5056640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b3e30 0x7effd0144a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7effcc034040 tx=0x7effcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effc5ffb640 1 -- 172.21.15.87:0/1939058885 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc041030 con 0x7effd00b3e30 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effc5ffb640 1 -- 172.21.15.87:0/1939058885 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effcc003bd0 con 0x7effd00b3e30 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd0145230 con 0x7effd00b3e30 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effc5ffb640 1 -- 172.21.15.87:0/1939058885 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc003de0 con 0x7effd00b3e30 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.215+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd014b770 con 0x7effd00b3e30 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.216+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd00691f0 con 0x7effd00b3e30 2024-05-09T08:02:01.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.217+0000 7effc5ffb640 1 -- 172.21.15.87:0/1939058885 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effcc044070 con 0x7effd00b3e30 2024-05-09T08:02:01.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.217+0000 7effc5ffb640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7effb406be30 0x7effb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:01.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.217+0000 7effd4855640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7effb406be30 0x7effb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:01.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.217+0000 7effc5ffb640 1 -- 172.21.15.87:0/1939058885 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7effcc0ab880 con 0x7effd00b3e30 2024-05-09T08:02:01.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.218+0000 7effd4855640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7effb406be30 0x7effb406e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effd013ea00 tx=0x7effc0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:01.239 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.221+0000 7effc5ffb640 1 -- 172.21.15.87:0/1939058885 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7effd0144fb0 con 0x7effd00b3e30 2024-05-09T08:02:01.461 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.443+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7effd00731f0 con 0x7effd00b3e30 2024-05-09T08:02:01.465 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.448+0000 7effc5ffb640 1 -- 172.21.15.87:0/1939058885 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v5) ==== 81+0+470454 (secure 0 0 0) 0x7effcc079be0 con 0x7effd00b3e30 2024-05-09T08:02:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:01.472 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "epoch": 5, 2024-05-09T08:02:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "active_gid": 4113, 2024-05-09T08:02:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "active_name": "y", 2024-05-09T08:02:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "active_addrs": { 2024-05-09T08:02:01.472 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6832", 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1321160324 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:6833", 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 1321160324 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "active_addr": "172.21.15.87:6833/1321160324", 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "active_change": "2024-05-09T07:54:16.881346+0000", 2024-05-09T08:02:01.473 INFO:teuthology.orchestra.run.smithi087.stdout: "active_mgr_features": 4540701547738038271, 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "available": true, 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "standbys": [ 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "gid": 4103, 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "x", 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "mgr_features": 4540701547738038271, 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "available_modules": [ 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "alerts", 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:01.474 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.475 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.476 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.477 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.478 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.479 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_destination": { 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_destination", 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email address to send alerts to", 2024-05-09T08:02:01.480 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_from_name": { 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_from_name", 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "Ceph", 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email From: name", 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.481 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_host": { 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_host", 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP server", 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.482 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_password": { 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_password", 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Password to authenticate with", 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_port": { 2024-05-09T08:02:01.483 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_port", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "465", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP port", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_sender": { 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_sender", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.484 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP envelope sender", 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_ssl": { 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_ssl", 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.485 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_user": { 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_user", 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.486 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "User to authenticate as", 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "balancer", 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.487 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "active": { 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "active", 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_time": { 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_time", 2024-05-09T08:02:01.488 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0000", 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_weekday": { 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_weekday", 2024-05-09T08:02:01.489 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_max_iterations": { 2024-05-09T08:02:01.490 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_max_iterations", 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "25", 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "250", 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_metrics": { 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_metrics", 2024-05-09T08:02:01.491 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_step": { 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_step", 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.492 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.5", 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0.001", 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "0.999", 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "aggressiveness of optimization", 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "end_time": { 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_time", 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.493 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2359", 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "end_weekday": { 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_weekday", 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.494 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.495 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.496 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.497 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.498 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.499 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "min_score": { 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_score", 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.500 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "upmap", 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.501 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-compat", 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "none", 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "read", 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap", 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap-read" 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Balancer mode", 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_ids": { 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_ids", 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.502 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.503 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_deviation": { 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_deviation", 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.504 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_optimizations": { 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_optimizations", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.505 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.506 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T08:02:01.506 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.506 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.506 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.506 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.506 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.506 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.506 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.506 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_down_multiplier": { 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_down_multiplier", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.507 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_refresh_rate": { 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_refresh_rate", 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "20", 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.508 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_starting_port": { 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_starting_port", 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4721", 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_ptrace": { 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_ptrace", 2024-05-09T08:02:01.509 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_interval": { 2024-05-09T08:02:01.510 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_interval", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_memory_target_ratio": { 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.511 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.7", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm_log_destination": { 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm_log_destination", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.512 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "file", 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "file,syslog", 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "syslog" 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "cgroups_split": { 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cgroups_split", 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.513 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "config_checks_enabled": { 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_checks_enabled", 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.514 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "config_dashboard": { 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_dashboard", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.515 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_alertmanager": { 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_alertmanager", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-09T08:02:01.516 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_base": { 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_base", 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Container image name, without the tag", 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.517 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_elasticsearch": { 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_elasticsearch", 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "elasticsearch container image", 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.518 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_grafana": { 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_grafana", 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_haproxy": { 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_haproxy", 2024-05-09T08:02:01.519 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "HAproxy container image", 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_agent": { 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_agent", 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.520 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger agent container image", 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_collector": { 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_collector", 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.521 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger collector container image", 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_query": { 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_query", 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.522 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger query container image", 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_keepalived": { 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_keepalived", 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.523 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.525 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.525 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T08:02:01.525 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.525 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.525 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.525 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Keepalived container image", 2024-05-09T08:02:01.525 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.525 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_loki": { 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_loki", 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Loki container image", 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.526 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_node_exporter": { 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_node_exporter", 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.527 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_nvmeof": { 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_nvmeof", 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Nvme-of container image", 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_prometheus": { 2024-05-09T08:02:01.528 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_prometheus", 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_promtail": { 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_promtail", 2024-05-09T08:02:01.529 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Promtail container image", 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_samba": { 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_samba", 2024-05-09T08:02:01.530 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Samba/SMB container image", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_snmp_gateway": { 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_snmp_gateway", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.531 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SNMP Gateway container image", 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "container_init": { 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_init", 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.532 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "daemon_cache_timeout": { 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "daemon_cache_timeout", 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.533 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "default_cephadm_command_timeout": { 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "900", 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.534 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "default_registry": { 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_registry", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.535 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "device_cache_timeout": { 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_cache_timeout", 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1800", 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache device inventory", 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.536 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "device_enhanced_scan": { 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_enhanced_scan", 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "facts_cache_timeout": { 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "facts_cache_timeout", 2024-05-09T08:02:01.537 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache host facts data", 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "grafana_dashboards_path": { 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "grafana_dashboards_path", 2024-05-09T08:02:01.538 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "host_check_interval": { 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "host_check_interval", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.539 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to perform a host check", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "hw_monitoring": { 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hw_monitoring", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.540 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "inventory_list_all": { 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "inventory_list_all", 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.541 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.542 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "log_refresh_metadata": { 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_refresh_metadata", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.543 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.544 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.545 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.546 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.547 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "*", 2024-05-09T08:02:01.548 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "max_count_per_host": { 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_count_per_host", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.549 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of daemons per service per host", 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd_draining_count": { 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_osd_draining_count", 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T08:02:01.550 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "migration_current": { 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "migration_current", 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "internal - do not modify", 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.551 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "root", 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm-package", 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "root" 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.552 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "oob_default_addr": { 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "oob_default_addr", 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "169.254.1.1", 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "prometheus_alerts_path": { 2024-05-09T08:02:01.553 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus_alerts_path", 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.554 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_insecure": { 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_insecure", 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.555 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_password": { 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_password", 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.556 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_url": { 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_url", 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_username": { 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_username", 2024-05-09T08:02:01.557 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "secure_monitoring_stack": { 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "secure_monitoring_stack", 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.558 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "service_discovery_port": { 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "service_discovery_port", 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.559 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8765", 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "cephadm service discovery port", 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "ssh_config_file": { 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssh_config_file", 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.560 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "use_agent": { 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_agent", 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.561 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "use_repo_digest": { 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_repo_digest", 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.562 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_failed_host_check": { 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_failed_host_check", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.563 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_daemons": { 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_daemons", 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.564 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_hosts": { 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_hosts", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.565 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crash", 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.566 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.567 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.568 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.569 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.570 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "retain_interval": { 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retain_interval", 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "31536000", 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.571 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_recent_interval": { 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_recent_interval", 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1209600", 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.572 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dashboard", 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.573 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.574 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.575 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_ENABLED": { 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.576 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T08:02:01.577 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T08:02:01.578 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T08:02:01.579 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T08:02:01.580 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.581 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.582 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.583 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.584 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.585 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.586 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.587 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_URL": { 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_URL", 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T08:02:01.588 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.589 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.590 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.591 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.592 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.593 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.594 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.595 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T08:02:01.596 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.597 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.598 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.599 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.600 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.601 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.602 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.603 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8", 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.604 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "45", 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.605 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.606 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T08:02:01.607 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T08:02:01.608 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T08:02:01.609 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T08:02:01.610 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.611 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "cross_origin_url": { 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cross_origin_url", 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.612 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "crt_file": { 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crt_file", 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.613 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "debug": { 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "debug", 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.614 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable/disable debug options", 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "jwt_token_ttl": { 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "jwt_token_ttl", 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.615 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "28800", 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.616 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.617 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.618 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.619 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.620 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.621 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "motd": { 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "motd", 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.622 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "The message of the day", 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect_resolve_ip_addr": { 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.623 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.624 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8080", 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.625 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.626 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl_server_port": { 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl_server_port", 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8443", 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.627 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "redirect", 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect" 2024-05-09T08:02:01.628 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.629 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "url_prefix": { 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url_prefix", 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.630 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_monitoring": { 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_monitoring", 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.631 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "monitor device health metrics", 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.632 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.633 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.634 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.635 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.636 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "mark_out_threshold": { 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mark_out_threshold", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2419200", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.637 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": { 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_name", 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "device_health_metrics", 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.638 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "retention_period": { 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retention_period", 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15552000", 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain device health metrics", 2024-05-09T08:02:01.639 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_frequency": { 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_frequency", 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T08:02:01.640 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "self_heal": { 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "self_heal", 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.641 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.642 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_threshold": { 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_threshold", 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7257600", 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.643 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "diskprediction_local", 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.644 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.645 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.646 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.647 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.648 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "predict_interval": { 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predict_interval", 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.649 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "predictor_model": { 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predictor_model", 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "prophetstor", 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.650 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.651 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "influx", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": false, 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "influxdb python module not found", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "batch_size": { 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "batch_size", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5000", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.652 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "database": { 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "database", 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "ceph", 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T08:02:01.653 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": { 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hostname", 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server hostname", 2024-05-09T08:02:01.654 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "30", 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "5", 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T08:02:01.655 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.656 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.657 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.658 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.659 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.660 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "password": { 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "password", 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "password of InfluxDB server user", 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.661 INFO:teuthology.orchestra.run.smithi087.stdout: "port": { 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "port", 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8086", 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server port", 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.662 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "false", 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "threads": { 2024-05-09T08:02:01.663 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threads", 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "32", 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "username": { 2024-05-09T08:02:01.664 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "username", 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "username of InfluxDB server user", 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "verify_ssl": { 2024-05-09T08:02:01.665 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "verify_ssl", 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "true", 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.666 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "insights", 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.667 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.668 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.669 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.670 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.671 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "iostat", 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.672 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.673 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.674 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.675 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.676 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "localpool", 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "failure_domain": { 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "failure_domain", 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.677 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "host", 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "failure domain for any created local pool", 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.678 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.679 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.680 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.681 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.682 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": { 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_size", 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.683 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default min_size for any created local pool", 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "num_rep": { 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "num_rep", 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3", 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.684 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default replica count for any created local pool", 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": { 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_num", 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "128", 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.685 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.686 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.686 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T08:02:01.686 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.686 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.686 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.686 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.686 INFO:teuthology.orchestra.run.smithi087.stdout: "prefix": { 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prefix", 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name prefix for any created local pool", 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "subtree": { 2024-05-09T08:02:01.687 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "subtree", 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "rack", 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.688 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mds_autoscaler", 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.689 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.690 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.691 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.692 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.693 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirroring", 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.694 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.695 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.696 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.696 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.696 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.696 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.696 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.696 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.696 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.696 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.696 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.697 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.698 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.699 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "nfs", 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.700 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.701 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.702 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.703 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.704 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "fail_fs": { 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "fail_fs", 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.705 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.706 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.707 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.708 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.709 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.710 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator": { 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "rook", 2024-05-09T08:02:01.711 INFO:teuthology.orchestra.run.smithi087.stdout: "test_orchestrator" 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Orchestrator backend", 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_perf_query", 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.712 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.713 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.714 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.715 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.716 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_support", 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.717 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.718 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.719 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.720 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.721 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_autoscaler", 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.722 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.723 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.724 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.725 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.726 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:01.727 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.728 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "threshold": { 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threshold", 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.729 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1.0", 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "scaling threshold", 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "progress", 2024-05-09T08:02:01.730 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_pg_recovery_event": { 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_pg_recovery_event", 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.731 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.732 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.733 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.734 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.735 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.736 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "max_completed_events": { 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_completed_events", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.737 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "50", 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "number of past completed events to remember", 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.738 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long the module is going to sleep", 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus", 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.739 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "cache": { 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cache", 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.740 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "exclude_perf_counters": { 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "exclude_perf_counters", 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.741 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.742 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.743 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.744 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.745 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools": { 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools", 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.746 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.747 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "300", 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_interval": { 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_interval", 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.748 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15.0", 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.749 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.750 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "9283", 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "stale_cache_strategy": { 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stale_cache_strategy", 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "log", 2024-05-09T08:02:01.751 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "default", 2024-05-09T08:02:01.752 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "default", 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "error" 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.753 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-05-09T08:02:01.754 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.755 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.756 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.757 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.758 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.759 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_snap_create": { 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_snap_create", 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.760 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "mirror_snapshot_schedule": { 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.761 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "trash_purge_schedule": { 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "trash_purge_schedule", 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.762 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "restful", 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_auth": { 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_auth", 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.763 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.764 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.765 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.766 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.767 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.768 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.769 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.770 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.771 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rgw", 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.772 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.773 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.774 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.775 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.776 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rook", 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.777 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.778 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.779 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.780 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.781 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "storage_class": { 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "storage_class", 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "local", 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.782 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "selftest", 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.783 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.784 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.785 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.786 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.787 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "roption1": { 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption1", 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.788 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "roption2": { 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption2", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "xyz", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.789 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption1": { 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption1", 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.790 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption2": { 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption2", 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.791 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption3": { 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption3", 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.792 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption4": { 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption4", 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.793 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption5": { 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption5", 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.794 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption6": { 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption6", 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.795 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption7": { 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption7", 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "42", 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.796 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "testkey": { 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testkey", 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.797 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "testlkey": { 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testlkey", 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.798 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "testnewline": { 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testnewline", 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.799 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_m_granularity": { 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_m_granularity", 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.800 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "dump_on_update": { 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dump_on_update", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.801 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "dump database to debug log on update", 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.802 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.803 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.804 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.805 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.806 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stats", 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.807 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.808 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.809 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.810 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.811 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "status", 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.812 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.813 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.814 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.815 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.816 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telegraf", 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "address": { 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "address", 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.817 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15", 2024-05-09T08:02:01.818 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.819 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.820 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.821 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.822 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.823 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telemetry", 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_basic": { 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_basic", 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.824 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_crash": { 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_crash", 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.825 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_device": { 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_device", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.826 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_ident": { 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_ident", 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T08:02:01.827 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_perf": { 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_perf", 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.828 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "contact": { 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "contact", 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.829 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "description": { 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "description", 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.830 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "device_url": { 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_url", 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.831 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.832 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "24", 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "8", 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.833 INFO:teuthology.orchestra.run.smithi087.stdout: "last_opt_revision": { 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "last_opt_revision", 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1", 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.834 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard": { 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard", 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard_description": { 2024-05-09T08:02:01.835 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard_description", 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.836 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.837 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.838 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.839 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.840 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "organization": { 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "organization", 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.841 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "proxy": { 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "proxy", 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.842 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "url": { 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.843 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "test_orchestrator", 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.844 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.845 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.846 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.847 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.848 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.849 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.852 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.853 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_clones": { 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_clones", 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4", 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.854 INFO:teuthology.orchestra.run.smithi087.stdout: "periodic_async_work": { 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "periodic_async_work", 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Periodically check for async work", 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_delay": { 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_delay", 2024-05-09T08:02:01.855 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_no_wait": { 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.856 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix", 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.857 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "discovery_interval": { 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "discovery_interval", 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "100", 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.858 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "identifier": { 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "identifier", 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:01.859 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.860 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.861 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.862 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.863 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.864 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_host": { 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_host", 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.865 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_port": { 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_port", 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10051", 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.866 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_sender": { 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_sender", 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.867 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: "modules": [ 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: "iostat", 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: "nfs", 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: "restful" 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: "available_modules": [ 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "alerts", 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.868 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.869 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.870 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.871 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.872 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.873 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_destination": { 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_destination", 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.874 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email address to send alerts to", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_from_name": { 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_from_name", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "Ceph", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Email From: name", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.875 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_host": { 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_host", 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP server", 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.876 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_password": { 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_password", 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Password to authenticate with", 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.877 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_port": { 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_port", 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "465", 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP port", 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.878 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_sender": { 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_sender", 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SMTP envelope sender", 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_ssl": { 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_ssl", 2024-05-09T08:02:01.879 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "smtp_user": { 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "smtp_user", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.880 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "User to authenticate as", 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "balancer", 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.881 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "active": { 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "active", 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.882 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_time": { 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_time", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0000", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "begin_weekday": { 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "begin_weekday", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:01.883 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_max_iterations": { 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_max_iterations", 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.884 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "25", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "250", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_metrics": { 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_metrics", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.885 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "crush_compat_step": { 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crush_compat_step", 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.5", 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0.001", 2024-05-09T08:02:01.886 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "0.999", 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "aggressiveness of optimization", 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "end_time": { 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_time", 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2359", 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.887 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "end_weekday": { 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "end_weekday", 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "0", 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "6", 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T08:02:01.888 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.889 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.890 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.891 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.892 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "min_score": { 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_score", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.893 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "upmap", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.894 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "crush-compat", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "none", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "read", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap-read" 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Balancer mode", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_ids": { 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_ids", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.895 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:01.896 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_deviation": { 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_deviation", 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-09T08:02:01.897 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "upmap_max_optimizations": { 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "upmap_max_optimizations", 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.898 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm", 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_down_multiplier": { 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_down_multiplier", 2024-05-09T08:02:01.899 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_refresh_rate": { 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_refresh_rate", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.900 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "20", 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "agent_starting_port": { 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "agent_starting_port", 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4721", 2024-05-09T08:02:01.901 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_ptrace": { 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_ptrace", 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.902 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_interval": { 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_interval", 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:01.903 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "autotune_memory_target_ratio": { 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0.7", 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.904 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm_log_destination": { 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cephadm_log_destination", 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.905 INFO:teuthology.orchestra.run.smithi087.stdout: "file", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "file,syslog", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "syslog" 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "cgroups_split": { 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cgroups_split", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.906 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "config_checks_enabled": { 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_checks_enabled", 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T08:02:01.907 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "config_dashboard": { 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "config_dashboard", 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.908 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_alertmanager": { 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_alertmanager", 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.909 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_base": { 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_base", 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Container image name, without the tag", 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.910 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_elasticsearch": { 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_elasticsearch", 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "elasticsearch container image", 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.911 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_grafana": { 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_grafana", 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_haproxy": { 2024-05-09T08:02:01.912 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_haproxy", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "HAproxy container image", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_agent": { 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_agent", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.913 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger agent container image", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_collector": { 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_collector", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.914 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger collector container image", 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_jaeger_query": { 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_jaeger_query", 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.915 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Jaeger query container image", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_keepalived": { 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_keepalived", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Keepalived container image", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.916 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_loki": { 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_loki", 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Loki container image", 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.917 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_node_exporter": { 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_node_exporter", 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.918 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_nvmeof": { 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_nvmeof", 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Nvme-of container image", 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_prometheus": { 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_prometheus", 2024-05-09T08:02:01.919 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Prometheus container image", 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_promtail": { 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_promtail", 2024-05-09T08:02:01.920 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Promtail container image", 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_samba": { 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_samba", 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.921 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Samba/SMB container image", 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "container_image_snmp_gateway": { 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_image_snmp_gateway", 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.922 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "SNMP Gateway container image", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "container_init": { 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "container_init", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.923 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "daemon_cache_timeout": { 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "daemon_cache_timeout", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.924 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "default_cephadm_command_timeout": { 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "900", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.925 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "default_registry": { 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "default_registry", 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "docker.io", 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.926 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "device_cache_timeout": { 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_cache_timeout", 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1800", 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache device inventory", 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "device_enhanced_scan": { 2024-05-09T08:02:01.927 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_enhanced_scan", 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "facts_cache_timeout": { 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "facts_cache_timeout", 2024-05-09T08:02:01.928 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "seconds to cache host facts data", 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "grafana_dashboards_path": { 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "grafana_dashboards_path", 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.929 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "host_check_interval": { 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "host_check_interval", 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.930 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to perform a host check", 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "hw_monitoring": { 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hw_monitoring", 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.931 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "inventory_list_all": { 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "inventory_list_all", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.932 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.933 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "log_refresh_metadata": { 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_refresh_metadata", 2024-05-09T08:02:01.934 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.935 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.936 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.937 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.938 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "*", 2024-05-09T08:02:01.939 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "max_count_per_host": { 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_count_per_host", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.940 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of daemons per service per host", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "max_osd_draining_count": { 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_osd_draining_count", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.941 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "migration_current": { 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "migration_current", 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "internal - do not modify", 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.942 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "mode": { 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mode", 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "root", 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm-package", 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "root" 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.943 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "oob_default_addr": { 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "oob_default_addr", 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "169.254.1.1", 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "prometheus_alerts_path": { 2024-05-09T08:02:01.944 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus_alerts_path", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_insecure": { 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_insecure", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.945 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_password": { 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_password", 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.946 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_url": { 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_url", 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.947 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "registry_username": { 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "registry_username", 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.948 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "secure_monitoring_stack": { 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "secure_monitoring_stack", 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.949 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "service_discovery_port": { 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "service_discovery_port", 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8765", 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "cephadm service discovery port", 2024-05-09T08:02:01.950 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "ssh_config_file": { 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssh_config_file", 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.951 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "use_agent": { 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_agent", 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.952 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "use_repo_digest": { 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "use_repo_digest", 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.953 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_failed_host_check": { 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_failed_host_check", 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.954 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_daemons": { 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_daemons", 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_on_stray_hosts": { 2024-05-09T08:02:01.955 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_on_stray_hosts", 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.956 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crash", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.957 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.958 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:01.959 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:01.960 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "retain_interval": { 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retain_interval", 2024-05-09T08:02:01.961 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "31536000", 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_recent_interval": { 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_recent_interval", 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:01.962 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1209600", 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dashboard", 2024-05-09T08:02:01.963 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.964 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.965 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_ENABLED": { 2024-05-09T08:02:01.966 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.967 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.968 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.969 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.970 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.971 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.972 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.973 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.974 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T08:02:01.975 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.976 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.977 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_URL": { 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_URL", 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.978 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.979 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.980 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.981 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.982 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.983 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.984 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.985 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.986 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.987 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.988 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.989 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.990 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.991 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.992 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T08:02:01.993 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T08:02:01.994 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T08:02:01.995 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8", 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T08:02:01.996 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "45", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.997 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "admin", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.998 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:01.999 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.000 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.001 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.002 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.003 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "cross_origin_url": { 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cross_origin_url", 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.004 INFO:teuthology.orchestra.run.smithi087.stdout: "crt_file": { 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "crt_file", 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "debug": { 2024-05-09T08:02:02.005 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "debug", 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Enable/disable debug options", 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "jwt_token_ttl": { 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "jwt_token_ttl", 2024-05-09T08:02:02.006 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "28800", 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-09T08:02:02.007 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.008 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.009 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.010 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.011 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.012 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "motd": { 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "motd", 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.013 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "The message of the day", 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect_resolve_ip_addr": { 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.014 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.015 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8080", 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.016 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.017 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl_server_port": { 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl_server_port", 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8443", 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.018 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "redirect", 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.019 INFO:teuthology.orchestra.run.smithi087.stdout: "redirect" 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-09T08:02:02.020 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "url_prefix": { 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url_prefix", 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.021 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_monitoring": { 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_monitoring", 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.022 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "monitor device health metrics", 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.023 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.024 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.025 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.026 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.027 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "mark_out_threshold": { 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mark_out_threshold", 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "2419200", 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.028 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "pool_name": { 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pool_name", 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "device_health_metrics", 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T08:02:02.029 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "retention_period": { 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "retention_period", 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15552000", 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long to retain device health metrics", 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.030 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_frequency": { 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_frequency", 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.031 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "self_heal": { 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "self_heal", 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.032 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.033 INFO:teuthology.orchestra.run.smithi087.stdout: "warn_threshold": { 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "warn_threshold", 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "7257600", 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.034 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "diskprediction_local", 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.035 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.036 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.037 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.038 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.039 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "predict_interval": { 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predict_interval", 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "86400", 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.040 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "predictor_model": { 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "predictor_model", 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "prophetstor", 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.041 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "600", 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.042 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "influx", 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": false, 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "influxdb python module not found", 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "batch_size": { 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "batch_size", 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5000", 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.043 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "database": { 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "database", 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "ceph", 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T08:02:02.044 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": { 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "hostname", 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server hostname", 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.045 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "30", 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "5", 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.046 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.047 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.048 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.049 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.050 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "password": { 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "password", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.051 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "password of InfluxDB server user", 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "port": { 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "port", 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.052 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "8086", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "InfluxDB server port", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "ssl": { 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "ssl", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "false", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.053 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "threads": { 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threads", 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-09T08:02:02.054 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "32", 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "username": { 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "username", 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.055 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "username of InfluxDB server user", 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "verify_ssl": { 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "verify_ssl", 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "true", 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T08:02:02.056 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "insights", 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.057 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.058 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.059 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.060 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.061 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "iostat", 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.062 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.063 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.064 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.065 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.066 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.067 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "localpool", 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "failure_domain": { 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "failure_domain", 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "host", 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.068 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.069 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "failure domain for any created local pool", 2024-05-09T08:02:02.069 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T08:02:02.069 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.069 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.069 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.069 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.069 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.069 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.069 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.070 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.070 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.070 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.070 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.070 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.070 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.070 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.071 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.071 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.071 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.071 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.071 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.071 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.071 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.071 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.072 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.072 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.072 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.072 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.072 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.072 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.072 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.072 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.073 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.073 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.073 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.073 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.073 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.073 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.073 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.073 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.073 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.074 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.075 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "min_size": { 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "min_size", 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default min_size for any created local pool", 2024-05-09T08:02:02.076 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "num_rep": { 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "num_rep", 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3", 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default replica count for any created local pool", 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.077 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_num": { 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_num", 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "128", 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.078 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "prefix": { 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prefix", 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "name prefix for any created local pool", 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.079 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "subtree": { 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "subtree", 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "rack", 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.080 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mds_autoscaler", 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.081 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.082 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.083 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.084 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.085 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirroring", 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.086 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.087 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.088 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.089 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.090 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "nfs", 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.091 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.092 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.093 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.094 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.095 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.096 INFO:teuthology.orchestra.run.smithi087.stdout: "fail_fs": { 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "fail_fs", 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.097 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.098 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.099 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.100 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.101 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator": { 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "orchestrator", 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.102 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "cephadm", 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "rook", 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "test_orchestrator" 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Orchestrator backend", 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.103 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_perf_query", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.104 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.105 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.106 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.107 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.108 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "osd_support", 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.109 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.110 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.111 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.112 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.113 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "pg_autoscaler", 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.114 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.115 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.116 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.117 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.118 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.119 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "threshold": { 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "threshold", 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "3.0", 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1.0", 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "scaling threshold", 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.120 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "progress", 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_pg_recovery_event": { 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_pg_recovery_event", 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.121 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.122 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.123 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.124 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.125 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.126 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.127 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "max_completed_events": { 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_completed_events", 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "50", 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "number of past completed events to remember", 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "sleep_interval": { 2024-05-09T08:02:02.128 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "sleep_interval", 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "5", 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "how long the module is going to sleep", 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.129 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "prometheus", 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "cache": { 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "cache", 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.130 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "exclude_perf_counters": { 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "exclude_perf_counters", 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.131 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.132 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.133 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.134 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.135 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.137 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools": { 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools", 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.138 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "300", 2024-05-09T08:02:02.139 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "scrape_interval": { 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "scrape_interval", 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15.0", 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.140 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "::", 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.141 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "9283", 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.142 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "stale_cache_strategy": { 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stale_cache_strategy", 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "log", 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.143 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_behaviour": { 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_behaviour", 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "default", 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "default", 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: "error" 2024-05-09T08:02:02.144 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "standby_error_status_code": { 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "standby_error_status_code", 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "500", 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "400", 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "599", 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.145 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.146 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.147 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.148 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.149 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.150 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_snap_create": { 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_snap_create", 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10", 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.151 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "mirror_snapshot_schedule": { 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.152 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "trash_purge_schedule": { 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "trash_purge_schedule", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.153 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "restful", 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "enable_auth": { 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enable_auth", 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.154 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "key_file": { 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "key_file", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.155 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.156 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.157 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.158 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.159 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.160 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "server_addr": { 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_addr", 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.161 INFO:teuthology.orchestra.run.smithi087.stdout: "server_port": { 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "server_port", 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.162 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rgw", 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.163 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.164 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.165 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.166 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.167 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rook", 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.168 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.169 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.170 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.171 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.172 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "storage_class": { 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "storage_class", 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "local", 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.173 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "selftest", 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.174 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.175 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.176 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.177 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.178 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "roption1": { 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption1", 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.179 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "roption2": { 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "roption2", 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "xyz", 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.180 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption1": { 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption1", 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.181 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption2": { 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption2", 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.182 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption3": { 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption3", 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "float", 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption4": { 2024-05-09T08:02:02.183 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption4", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption5": { 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption5", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.184 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption6": { 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption6", 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.185 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "rwoption7": { 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rwoption7", 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.186 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "1", 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "42", 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "testkey": { 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testkey", 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.187 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "testlkey": { 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testlkey", 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.188 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "testnewline": { 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "testnewline", 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.189 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snap_schedule", 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "allow_m_granularity": { 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "allow_m_granularity", 2024-05-09T08:02:02.190 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "dump_on_update": { 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "dump_on_update", 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.191 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "dump database to debug log on update", 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.192 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.193 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.194 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.195 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.196 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "stats", 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.197 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.198 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.199 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.200 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.201 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "status", 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.202 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.203 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.204 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.205 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.206 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telegraf", 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.207 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "address": { 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "address", 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.208 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "15", 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.209 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.210 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.211 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.212 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.213 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.214 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "telemetry", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_basic": { 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_basic", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.215 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_crash": { 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_crash", 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.216 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_device": { 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_device", 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_ident": { 2024-05-09T08:02:02.217 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_ident", 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "channel_perf": { 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "channel_perf", 2024-05-09T08:02:02.218 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "contact": { 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "contact", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.219 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "description": { 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "description", 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.220 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "device_url": { 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "device_url", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.221 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "enabled": { 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "enabled", 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.222 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "24", 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "8", 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.223 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "last_opt_revision": { 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "last_opt_revision", 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "1", 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.224 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard": { 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard", 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.225 INFO:teuthology.orchestra.run.smithi087.stdout: "leaderboard_description": { 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "leaderboard_description", 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.226 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.227 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.228 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.229 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.230 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "organization": { 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "organization", 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.231 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "proxy": { 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "proxy", 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.232 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "url": { 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "url", 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.233 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "test_orchestrator", 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.234 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.235 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.236 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.237 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.238 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.239 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.240 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.241 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.242 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.243 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "max_concurrent_clones": { 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "max_concurrent_clones", 2024-05-09T08:02:02.244 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "4", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "periodic_async_work": { 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "periodic_async_work", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.245 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Periodically check for async work", 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_delay": { 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_delay", 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.246 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "0", 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "snapshot_clone_no_wait": { 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "True", 2024-05-09T08:02:02.247 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix", 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "can_run": true, 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "error_string": "", 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "module_options": { 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "discovery_interval": { 2024-05-09T08:02:02.248 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "discovery_interval", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "uint", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "100", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "identifier": { 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "identifier", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.249 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "interval": { 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "interval", 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "secs", 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.250 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "60", 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "log_level": { 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_level", 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.251 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.252 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster": { 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster", 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_cluster_level": { 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_cluster_level", 2024-05-09T08:02:02.253 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "info", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [ 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "critical", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "debug", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "error", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "info", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "warning" 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.254 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "log_to_file": { 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "log_to_file", 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "bool", 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 1, 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "False", 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.255 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_host": { 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_host", 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "", 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.256 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_port": { 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_port", 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "int", 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "10051", 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "zabbix_sender": { 2024-05-09T08:02:02.257 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "zabbix_sender", 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "str", 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "level": "advanced", 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "flags": 0, 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "min": "", 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "max": "", 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "enum_allowed": [], 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "desc": "", 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "long_desc": "", 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "tags": [], 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: "see_also": [] 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.258 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "services": {}, 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "always_on_modules": { 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "octopus": [ 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "pacific": [ 2024-05-09T08:02:02.259 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "quincy": [ 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-09T08:02:02.260 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "reef": [ 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-09T08:02:02.261 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: ], 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "squid": [ 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "balancer", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "crash", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "devicehealth", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "orchestrator", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "pg_autoscaler", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "progress", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "rbd_support", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "status", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "telemetry", 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "volumes" 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.262 INFO:teuthology.orchestra.run.smithi087.stdout: "last_failure_osd_epoch": 0, 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: "active_clients": [ 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "devicehealth", 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2360778072 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "libcephsqlite", 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.263 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 334967867 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "rbd_support", 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3508437055 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.264 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: "name": "volumes", 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: "addrvec": [ 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: { 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v2", 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 3353797740 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout: ] 2024-05-09T08:02:02.265 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7effb406be30 msgr2=0x7effb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7effb406be30 0x7effb406e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effd013ea00 tx=0x7effc0008040 comp rx=0 tx=0).stop 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b3e30 msgr2=0x7effd0144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b3e30 0x7effd0144a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7effcc034040 tx=0x7effcc0046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 shutdown_connections 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7effb406be30 0x7effb406e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd00b5e20 0x7effd01e0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd0141ac0 0x7effd01e0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 --2- 172.21.15.87:0/1939058885 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7effd00b3e30 0x7effd0144a70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 >> 172.21.15.87:0/1939058885 conn(0x7effd00676a0 msgr2=0x7effd00ba170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:02.267 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 shutdown_connections 2024-05-09T08:02:02.268 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:01.452+0000 7effd72ba640 1 -- 172.21.15.87:0/1939058885 wait complete. 2024-05-09T08:02:02.271 DEBUG:tasks.check_counter:Getting stats from a 2024-05-09T08:02:02.271 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2024-05-09T08:02:02.392 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:02.392 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 14331, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 14331, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 5420736, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 181296103, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 7, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 3, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 1.642231174, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.880326864, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.231038916, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.457005064, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 14330, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 4.614431643, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000322011 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.393 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 1194213, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 394548, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 408359058, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 221249674, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 8, 2024-05-09T08:02:02.394 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 7, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 45.777178534, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 23.532144174, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 32.047888531, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.374967162, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 394546, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 9.720351543, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000024636 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 1509890, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.207528634, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000137 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T08:02:02.395 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 248624 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_messages": 17956, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages": 17951, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_bytes": 5007277, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_bytes": 251320077, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_created_connections": 5, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_active_connections": 4, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_total_time": 1.808224250, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_send_time": 0.901302725, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_recv_time": 0.272032817, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_running_fast_dispatch_time": 0.557976900, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 17951, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 5.219133640, 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000290743 2024-05-09T08:02:02.396 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_handle_ack_lat": { 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_recv_encrypted_bytes": 145408, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "msgr_send_encrypted_bytes": 81856 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "cct": { 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "total_workers": 1, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "unhealthy_workers": 0 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-MDSRank": { 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 23765, 2024-05-09T08:02:02.397 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 60.031438693, 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002526044 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "finisher-PurgeQueue": { 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "queue_len": 0, 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "complete_latency": { 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 12653, 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 4.400631830, 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000347793 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "mds": { 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "request": 279009, 2024-05-09T08:02:02.398 INFO:teuthology.orchestra.run.smithi087.stdout: "reply": 279009, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "reply_latency": { 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 279009, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 666.827916438, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002389987 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_reply": 0, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "forward": 0, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_complete": 0, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_fetch_keys": 0, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_commit": 1126, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_split": 53, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_merge": 0, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes": 361, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_top": 0, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_bottom": 361, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pin_tail": 0, 2024-05-09T08:02:02.399 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_pinned": 361, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_expired": 0, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "inodes_with_caps": 2, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "caps": 2, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "subtrees": 2, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse": 529504, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_hit": 112361, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_forward": 0, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_discover": 0, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_dir_fetch": 0, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_remote_ino": 0, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "traverse_lock": 5342, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "load_cent": 0, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "q": 0, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "exported": 0, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "exported_inodes": 0, 2024-05-09T08:02:02.400 INFO:teuthology.orchestra.run.smithi087.stdout: "imported": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "imported_inodes": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_dir_fetch": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_backtrace_fetch": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "openino_peer_discover": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rfiles": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rbytes": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "root_rsnaps": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_set_tag": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_inotable_repaired": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_inodes": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "scrub_file_inodes": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_inode_file_caps": 0, 2024-05-09T08:02:02.401 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_revoke": 17029, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_grant": 35606, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_trunc": 5, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps": 906651, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_caps_dirty": 15072, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_cap_release": 364, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "process_request_cap_release": 83947 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_cache": { 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update": 0, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_update_receipt": 0, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_try_discover": 0, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_send_discover": 0, 2024-05-09T08:02:02.402 INFO:teuthology.orchestra.run.smithi087.stdout: "dir_handle_discover": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays": 1, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_delayed": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "num_strays_enqueuing": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_created": 14973, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_enqueued": 14972, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_reintegrated": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "strays_migrated": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_processing": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_enqueued": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "num_recovering_prioritized": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_started": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "recovery_completed": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_path": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_quiesce_inode": 0, 2024-05-09T08:02:02.403 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_exportdir": 0, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_flush": 0, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragmentdir": 53, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_fragstats": 0, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "ireq_inodestats": 0 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_log": { 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "evlrg": 0, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "evadd": 406902, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "evex": 300141, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "evtrm": 294961, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "ev": 111941, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "evexg": 0, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "evexd": 5180, 2024-05-09T08:02:02.404 INFO:teuthology.orchestra.run.smithi087.stdout: "segadd": 486, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "segex": 358, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "segtrm": 352, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "seg": 134, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "segmjr": 10, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "segexg": 0, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "segexd": 6, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "expos": 376780135, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "wrpos": 522085301, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "rdpos": 0, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "jlat": { 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 11645, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 34.136804640, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002931455 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: "replayed": 0 2024-05-09T08:02:02.405 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_mem": { 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "ino": 14, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "ino+": 14986, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "ino-": 14972, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "dir": 13, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "dir+": 513, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "dir-": 500, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "dn": 12, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "dn+": 36998, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "dn-": 36986, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "cap": 1, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "cap+": 14974, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "cap-": 14973, 2024-05-09T08:02:02.406 INFO:teuthology.orchestra.run.smithi087.stdout: "rss": 114240, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "heap": 231788 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_server": { 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_client_request": 286656, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "dispatch_server_request": 0, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_request": 279009, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_client_session": 24, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "handle_peer_request": 0, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "req_create_latency": { 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 14893, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 45.634326813, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.003064146 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getattr_latency": { 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 731, 2024-05-09T08:02:02.407 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.148382697, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000202985 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getfilelock_latency": { 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "req_link_latency": { 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookup_latency": { 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 229686, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 497.147115975, 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002164464 2024-05-09T08:02:02.408 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookuphash_latency": { 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupino_latency": { 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupname_latency": { 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupparent_latency": { 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.409 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lookupsnap_latency": { 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "req_lssnap_latency": { 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mkdir_latency": { 2024-05-09T08:02:02.410 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 77, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.200478117, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002603611 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mknod_latency": { 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "req_mksnap_latency": { 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "req_open_latency": { 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 7855, 2024-05-09T08:02:02.411 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 17.977906651, 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.002288721 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "req_readdir_latency": { 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 797, 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.878787279, 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.001102618 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rename_latency": { 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 14517, 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 86.934992211, 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.005988495 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "req_renamesnap_latency": { 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.412 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "req_snapdiff_latency": { 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmdir_latency": { 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 77, 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 5.497858184, 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.071400755 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmsnap_latency": { 2024-05-09T08:02:02.413 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "req_rmxattr_latency": { 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setattr_latency": { 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 1, 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000273132, 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000273132 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setdirlayout_latency": { 2024-05-09T08:02:02.414 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setfilelock_latency": { 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setlayout_latency": { 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "req_setxattr_latency": { 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.415 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "req_symlink_latency": { 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 3, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.002345211, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000781737 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "req_unlink_latency": { 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 10372, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 12.405450168, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.001196051 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_revoke_eviction": 0, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "cap_acquisition_throttle": 0, 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "req_getvxattr_latency": { 2024-05-09T08:02:02.416 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_sessions": { 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "session_count": 1, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "session_add": 1, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "session_remove": 0, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_open": 1, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions_stale": 0, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "total_load": 61487, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "average_load": 61487, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "avg_session_uptime": 424, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "mdthresh_evicted": 0 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "mempool": { 2024-05-09T08:02:02.417 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_bytes": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bloom_filter_items": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_alloc_items": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_data_items": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_other_items": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_bytes": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_extent_items": 0, 2024-05-09T08:02:02.418 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_bytes": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_blob_items": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_fsck_items": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_bytes": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_txc_items": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_bytes": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluestore_writing_items": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_bytes": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_items": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T08:02:02.419 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_reader_items": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "bluefs_file_writer_items": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_bytes": 243482, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_anon_items": 94, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_bytes": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "buffer_meta_items": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_bytes": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_items": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_bytes": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_mapbl_items": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_bytes": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_pglog_items": 0, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_bytes": 5792, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_items": 85, 2024-05-09T08:02:02.420 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "osdmap_mapping_items": 0, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_bytes": 0, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "pgmap_items": 0, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_bytes": 58280, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_co_items": 297, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_bytes": 0, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_1_items": 0, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_bytes": 0, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "unittest_2_items": 0 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "objecter": { 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "op_active": 0, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "op_laggy": 0, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send": 39874, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "op_send_bytes": 535507629, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "op_resend": 37, 2024-05-09T08:02:02.421 INFO:teuthology.orchestra.run.smithi087.stdout: "op_reply": 39874, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "op_latency": { 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 39874, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 202.274592966, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.005072844 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "op_inflight": 0, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "oplen_avg": { 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 39874, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 61562 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "op": 39874, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "op_r": 686, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "op_w": 39188, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "op_rmw": 0, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "op_pg": 0, 2024-05-09T08:02:02.422 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_stat": 620, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_create": 9326, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_read": 686, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_write": 12331, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writefull": 371, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_writesame": 0, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_append": 0, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_zero": 0, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_truncate": 53, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_delete": 15619, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_mapext": 0, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_sparse_read": 0, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_clonerange": 0, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_getxattr": 0, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_setxattr": 18652, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_cmpxattr": 0, 2024-05-09T08:02:02.423 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_rmxattr": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_resetxattrs": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_call": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_watch": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_notify": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_pgls_filter": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "osdop_other": 5, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_active": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_send": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_resend": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "linger_ping": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_active": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_send": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "poolop_resend": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_active": 0, 2024-05-09T08:02:02.424 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_send": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "poolstat_resend": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_active": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_send": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "statfs_resend": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "command_active": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "command_send": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "command_resend": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "map_epoch": 23, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "map_full": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "map_inc": 3, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_sessions": 8, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_open": 8, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_session_close": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_laggy": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_wr": 2937, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_rd": 0, 2024-05-09T08:02:02.425 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_del": 962 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "oft": { 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_objs": 1, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_kv_pairs": 0, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_updates": 0, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "omap_total_removes": 0 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "osd-slow-ops": { 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "slow_ops_count": 0 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "purge_queue": { 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops": 0, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_ops_high_water": 40, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing": 0, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executing_high_water": 32, 2024-05-09T08:02:02.426 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed_ops": 15396, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_executed": 14972, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "pq_item_in_journal": 0 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 1226495, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 308392415, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 1226495, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 1226495, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 308392415, 2024-05-09T08:02:02.427 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_bytes": { 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 104857600, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 39874, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 537020225, 2024-05-09T08:02:02.428 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 39874, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 537020225, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-objecter_ops": { 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 1024, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 0, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 0, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-09T08:02:02.429 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 0, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 39874, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 39874, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 39874, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 39874, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle": { 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-09T08:02:02.430 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 14972, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 1512596, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 14972, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 686, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 1512596, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "throttle-write_buf_throttle-0x55c96a0fc500": { 2024-05-09T08:02:02.431 INFO:teuthology.orchestra.run.smithi087.stdout: "val": 0, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "max": 3758096384, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "get_started": 0, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "get": 406902, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "get_sum": 517890997, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_fail": 0, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "get_or_fail_success": 406902, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "take": 0, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "take_sum": 0, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "put": 11645, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "put_sum": 517890997, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "wait": { 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "avgcount": 0, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.432 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.433 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-05-09T08:02:02.433 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:02.434 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=53 2024-05-09T08:02:02.434 DEBUG:tasks.check_counter:Getting stats from b 2024-05-09T08:02:02.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 4, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 4, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 1568, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 448, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 4, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 0, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.003047119, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.000030807, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.002163011, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T08:02:02.561 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 3, 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.003832830, 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.001277610 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.562 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 123, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 122, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 126336, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 75056, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 2, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 1, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.019355638, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.008280473, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.005822287, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.003092918, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 121, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.006232594, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000051509 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.563 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 126336, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 75056 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 2, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 94, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 267, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 94211, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 3, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 2, 2024-05-09T08:02:02.564 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.006579653, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.004364255, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.001065115, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 93, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.006093322, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000065519 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 94080 2024-05-09T08:02:02.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "cct": { 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "total_workers": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "unhealthy_workers": 0 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "mempool": { 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_bytes": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_items": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_items": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_items": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T08:02:02.566 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_items": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_bytes": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_items": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_bytes": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_items": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_items": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_bytes": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_items": 0, 2024-05-09T08:02:02.567 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_bytes": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_items": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_bytes": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_items": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_items": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_items": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_bytes": 149854, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_items": 28, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_bytes": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_items": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_bytes": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_items": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_bytes": 0, 2024-05-09T08:02:02.568 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_items": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_bytes": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_items": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_bytes": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_items": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_items": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_bytes": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_items": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_bytes": 928, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_items": 2, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_bytes": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_items": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_bytes": 0, 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_items": 0 2024-05-09T08:02:02.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 124, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 108962, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 124, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 124, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 108962, 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-05-09T08:02:02.570 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-05-09T08:02:02.571 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-05-09T08:02:02.571 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-05-09T08:02:02.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-05-09T08:02:02.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-05-09T08:02:02.571 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-05-09T08:02:02.572 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.b 2024-05-09T08:02:02.572 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-09T08:02:02.582 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-09T08:02:02.582 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T08:02:02.582 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T08:02:02.609 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T08:02:02.609 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T08:02:02.666 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T08:02:02.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.790+0000 7fceb9bc1640 1 Processor -- start 2024-05-09T08:02:02.808 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.790+0000 7fceb9bc1640 1 -- start start 2024-05-09T08:02:02.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb9bc1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fceb413fb60 0x7fceb4150f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:02.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb9bc1640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceb40b6240 con 0x7fceb40b5e60 2024-05-09T08:02:02.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb9bc1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceb40b5570 con 0x7fceb4072cb0 2024-05-09T08:02:02.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb9bc1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fceb40b2cb0 con 0x7fceb413fb60 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb37fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fceb40b5e60 0x7fceb4149280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60356/0 (socket says 172.21.15.87:60356) 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb37fe640 1 -- 172.21.15.87:0/76620351 learned_addr learned my addr 172.21.15.87:0/76620351 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597166151 0 0) 0x7fceb40b6240 con 0x7fceb40b5e60 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce9c003520 con 0x7fceb40b5e60 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb3fff640 1 --2- 172.21.15.87:0/76620351 >> v2:172.21.15.110:3300/0 conn(0x7fceb413fb60 0x7fceb4150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3502496932 0 0) 0x7fce9c003520 con 0x7fceb40b5e60 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 >> v2:172.21.15.110:3300/0 conn(0x7fceb413fb60 msgr2=0x7fceb4150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 --2- 172.21.15.87:0/76620351 >> v2:172.21.15.110:3300/0 conn(0x7fceb413fb60 0x7fceb4150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 >> v1:172.21.15.110:6789/0 conn(0x7fceb4072cb0 legacy=0x7fceb413f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb40b2ee0 con 0x7fceb40b5e60 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7fcea4001670 con 0x7fceb40b5e60 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 >> v1:172.21.15.87:6789/0 conn(0x7fceb40b5e60 legacy=0x7fceb4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.791+0000 7fceb27fc640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0039b0 0x7fce9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb27fc640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce9c004800 0x7fce9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb27fc640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9c0051c0 0x7fce9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:02.812 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c00c130 con 0x7fce9c004800 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c00c2e0 con 0x7fce9c0039b0 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c00c4e0 con 0x7fce9c0051c0 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb2ffd640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce9c004800 0x7fce9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb37fe640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0039b0 0x7fce9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb3fff640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9c0051c0 0x7fce9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb2ffd640 1 -- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9c0051c0 msgr2=0x7fce9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb2ffd640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9c0051c0 0x7fce9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb2ffd640 1 -- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0039b0 msgr2=0x7fce9c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb2ffd640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0039b0 0x7fce9c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb2ffd640 1 -- 172.21.15.87:0/76620351 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c003520 con 0x7fce9c004800 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb37fe640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c0039b0 0x7fce9c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb3fff640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce9c0051c0 0x7fce9c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.792+0000 7fceb3fff640 1 -- 172.21.15.87:0/76620351 reap_dead start 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb2ffd640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce9c004800 0x7fce9c004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcea8001750 tx=0x7fce9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7850b7ce15654f34 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea8001370 con 0x7fce9c004800 2024-05-09T08:02:02.813 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea80052d0 con 0x7fce9c004800 2024-05-09T08:02:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb27fc640 1 -- 172.21.15.87:0/76620351 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea802abc0 con 0x7fce9c004800 2024-05-09T08:02:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb9bc1640 1 -- 172.21.15.87:0/76620351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce9c004800 msgr2=0x7fce9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb9bc1640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce9c004800 0x7fce9c004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcea8001750 tx=0x7fce9c005830 comp rx=0 tx=0).stop 2024-05-09T08:02:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb9bc1640 1 -- 172.21.15.87:0/76620351 shutdown_connections 2024-05-09T08:02:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb9bc1640 1 --2- 172.21.15.87:0/76620351 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fce9c004800 0x7fce9c004c80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb9bc1640 1 -- 172.21.15.87:0/76620351 >> 172.21.15.87:0/76620351 conn(0x7fceb406c6a0 msgr2=0x7fceb406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb9bc1640 1 -- 172.21.15.87:0/76620351 shutdown_connections 2024-05-09T08:02:02.814 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.793+0000 7fceb9bc1640 1 -- 172.21.15.87:0/76620351 wait complete. 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.794+0000 7fceb9bc1640 1 Processor -- start 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.794+0000 7fceb9bc1640 1 -- start start 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb9bc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c004800 0x7fceb41d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb9bc1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fceb41453a0 0x7fceb4143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb9bc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb41443a0 0x7fceb41de3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb9bc1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fceb4148df0 con 0x7fceb41443a0 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb9bc1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fceb40b31c0 con 0x7fce9c004800 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb9bc1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fceb413f450 con 0x7fceb41453a0 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb41443a0 0x7fceb41de3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb41443a0 0x7fceb41de3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44236/0 (socket says 172.21.15.87:44236) 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb3fff640 1 -- 172.21.15.87:0/437235489 learned_addr learned my addr 172.21.15.87:0/437235489 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb37fe640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c004800 0x7fceb41d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb2ffd640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fceb41453a0 0x7fceb4143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb3fff640 1 -- 172.21.15.87:0/437235489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fceb41453a0 msgr2=0x7fceb4143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:02.817 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb3fff640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fceb41453a0 0x7fceb4143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb3fff640 1 -- 172.21.15.87:0/437235489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c004800 msgr2=0x7fceb41d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb3fff640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c004800 0x7fceb41d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb3fff640 1 -- 172.21.15.87:0/437235489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb4144820 con 0x7fceb41443a0 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.795+0000 7fceb37fe640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c004800 0x7fceb41d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.796+0000 7fceb3fff640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb41443a0 0x7fceb41de3f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fceb4072a70 tx=0x7fceac010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.796+0000 7fce9bfff640 1 -- 172.21.15.87:0/437235489 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac01a030 con 0x7fceb41443a0 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.796+0000 7fce9bfff640 1 -- 172.21.15.87:0/437235489 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac010da0 con 0x7fceb41443a0 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.796+0000 7fce9bfff640 1 -- 172.21.15.87:0/437235489 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4007d30 con 0x7fceb41443a0 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.796+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb4145880 con 0x7fceb41443a0 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.796+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb41cf9a0 con 0x7fceb41443a0 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.797+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb40691f0 con 0x7fceb41443a0 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.797+0000 7fce9bfff640 1 -- 172.21.15.87:0/437235489 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fceac01d070 con 0x7fceb41443a0 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.798+0000 7fce9bfff640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcea006be60 0x7fcea006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:02.818 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.798+0000 7fce9bfff640 1 -- 172.21.15.87:0/437235489 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fceac08b330 con 0x7fceb41443a0 2024-05-09T08:02:02.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.798+0000 7fceb37fe640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcea006be60 0x7fcea006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:02.819 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.798+0000 7fceb37fe640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcea006be60 0x7fcea006e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000fb0 tx=0x7fcea4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:02.820 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.802+0000 7fce9bfff640 1 -- 172.21.15.87:0/437235489 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fceb4144820 con 0x7fceb41443a0 2024-05-09T08:02:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.979+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fceb413ae20 con 0x7fceb41443a0 2024-05-09T08:02:02.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.980+0000 7fce9bfff640 1 -- 172.21.15.87:0/437235489 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16820 (secure 0 0 0) 0x7fceac059ce0 con 0x7fceb41443a0 2024-05-09T08:02:02.998 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:02.998 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:55:18.551072+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcea006be60 msgr2=0x7fcea006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcea006be60 0x7fcea006e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000fb0 tx=0x7fcea4009040 comp rx=0 tx=0).stop 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb41443a0 msgr2=0x7fceb41de3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb41443a0 0x7fceb41de3f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fceb4072a70 tx=0x7fceac010590 comp rx=0 tx=0).stop 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 shutdown_connections 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fcea006be60 0x7fcea006e320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fceb41453a0 0x7fceb4143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fceb41443a0 0x7fceb41de3f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 --2- 172.21.15.87:0/437235489 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce9c004800 0x7fceb41d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 >> 172.21.15.87:0/437235489 conn(0x7fceb406c6a0 msgr2=0x7fceb40b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 shutdown_connections 2024-05-09T08:02:03.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:02.982+0000 7fceb9bc1640 1 -- 172.21.15.87:0/437235489 wait complete. 2024-05-09T08:02:03.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T07:54:24.920922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T07:54:34.879628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T07:54:35.405648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T08:02:03.012 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T08:02:03.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.098+0000 7f79fd163640 1 Processor -- start 2024-05-09T08:02:03.116 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.098+0000 7f79fd163640 1 -- start start 2024-05-09T08:02:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79fd163640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f79f80b4dd0 0x7f79f80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79fd163640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79f80b56f0 0x7f79f81417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79fd163640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f80b4780 con 0x7f79f8141cf0 2024-05-09T08:02:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79fd163640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f79f8142180 con 0x7f79f80b4dd0 2024-05-09T08:02:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79fd163640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f79f80b6090 con 0x7f79f80b56f0 2024-05-09T08:02:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79f6d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f79f80b4dd0 0x7f79f80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79f6d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f79f80b4dd0 0x7f79f80b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44248/0 (socket says 172.21.15.87:44248) 2024-05-09T08:02:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79f6d9d640 1 -- 172.21.15.87:0/1514071912 learned_addr learned my addr 172.21.15.87:0/1514071912 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79f6d9d640 1 -- 172.21.15.87:0/1514071912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79f80b56f0 msgr2=0x7f79f81417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:03.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79f6d9d640 1 --2- 172.21.15.87:0/1514071912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79f80b56f0 0x7f79f81417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79f6d9d640 1 -- 172.21.15.87:0/1514071912 >> v1:172.21.15.110:6789/0 conn(0x7f79f8141cf0 legacy=0x7f79f8147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:03.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.099+0000 7f79f6d9d640 1 -- 172.21.15.87:0/1514071912 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f80b5e20 con 0x7f79f80b4dd0 2024-05-09T08:02:03.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.100+0000 7f79f6d9d640 1 --2- 172.21.15.87:0/1514071912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f80b4dd0 0x7f79f80b51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009e50 tx=0x7f79e802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cec0b930629ed96 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:03.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.100+0000 7f79f5d9b640 1 -- 172.21.15.87:0/1514071912 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8036070 con 0x7f79f80b4dd0 2024-05-09T08:02:03.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.100+0000 7f79f5d9b640 1 -- 172.21.15.87:0/1514071912 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e8031600 con 0x7f79f80b4dd0 2024-05-09T08:02:03.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.100+0000 7f79f5d9b640 1 -- 172.21.15.87:0/1514071912 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e80319d0 con 0x7f79f80b4dd0 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.101+0000 7f79fd163640 1 -- 172.21.15.87:0/1514071912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f80b4dd0 msgr2=0x7f79f80b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.101+0000 7f79fd163640 1 --2- 172.21.15.87:0/1514071912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f80b4dd0 0x7f79f80b51b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009e50 tx=0x7f79e802a630 comp rx=0 tx=0).stop 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.101+0000 7f79fd163640 1 -- 172.21.15.87:0/1514071912 shutdown_connections 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.101+0000 7f79fd163640 1 --2- 172.21.15.87:0/1514071912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79f80b56f0 0x7f79f81417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.101+0000 7f79fd163640 1 --2- 172.21.15.87:0/1514071912 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f80b4dd0 0x7f79f80b51b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.101+0000 7f79fd163640 1 -- 172.21.15.87:0/1514071912 >> 172.21.15.87:0/1514071912 conn(0x7f79f80677b0 msgr2=0x7f79f80bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.101+0000 7f79fd163640 1 -- 172.21.15.87:0/1514071912 shutdown_connections 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.101+0000 7f79fd163640 1 -- 172.21.15.87:0/1514071912 wait complete. 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79fd163640 1 Processor -- start 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79fd163640 1 -- start start 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79fd163640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f80b4dd0 0x7f79f81dd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79fd163640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79f80b56f0 0x7f79f81e1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79fd163640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f8141cf0 0x7f79f81439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79fd163640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f79f80b4200 con 0x7f79f8141cf0 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79fd163640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f79f80b4080 con 0x7f79f80b4dd0 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79fd163640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f79f8148400 con 0x7f79f80b56f0 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79f759e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f8141cf0 0x7f79f81439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.102+0000 7f79f759e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f8141cf0 0x7f79f81439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44250/0 (socket says 172.21.15.87:44250) 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f759e640 1 -- 172.21.15.87:0/2871522318 learned_addr learned my addr 172.21.15.87:0/2871522318 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f6d9d640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f80b4dd0 0x7f79f81dd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f659c640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79f80b56f0 0x7f79f81e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f759e640 1 -- 172.21.15.87:0/2871522318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79f80b56f0 msgr2=0x7f79f81e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f759e640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79f80b56f0 0x7f79f81e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f759e640 1 -- 172.21.15.87:0/2871522318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f80b4dd0 msgr2=0x7f79f81dd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f759e640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f80b4dd0 0x7f79f81dd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f759e640 1 -- 172.21.15.87:0/2871522318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f8144f50 con 0x7f79f8141cf0 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f6d9d640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f80b4dd0 0x7f79f81dd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79f759e640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f8141cf0 0x7f79f81439d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f79f000b410 tx=0x7f79f000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79ef7fe640 1 -- 172.21.15.87:0/2871522318 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0015030 con 0x7f79f8141cf0 2024-05-09T08:02:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79ef7fe640 1 -- 172.21.15.87:0/2871522318 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f0004020 con 0x7f79f8141cf0 2024-05-09T08:02:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f8145230 con 0x7f79f8141cf0 2024-05-09T08:02:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79ef7fe640 1 -- 172.21.15.87:0/2871522318 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0004410 con 0x7f79f8141cf0 2024-05-09T08:02:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.103+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f81e0910 con 0x7f79f8141cf0 2024-05-09T08:02:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.104+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f80691f0 con 0x7f79f8141cf0 2024-05-09T08:02:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.104+0000 7f79ef7fe640 1 -- 172.21.15.87:0/2871522318 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79f0018070 con 0x7f79f8141cf0 2024-05-09T08:02:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.105+0000 7f79ef7fe640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f79d806be30 0x7f79d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.105+0000 7f79f6d9d640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f79d806be30 0x7f79d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.105+0000 7f79ef7fe640 1 -- 172.21.15.87:0/2871522318 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f79f008a9e0 con 0x7f79f8141cf0 2024-05-09T08:02:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.106+0000 7f79f6d9d640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f79d806be30 0x7f79d806e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79e8033000 tx=0x7f79e8009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:03.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.109+0000 7f79ef7fe640 1 -- 172.21.15.87:0/2871522318 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f79f0059390 con 0x7f79f8141cf0 2024-05-09T08:02:03.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.283+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f79f8146700 con 0x7f79f8141cf0 2024-05-09T08:02:03.301 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.284+0000 7f79ef7fe640 1 -- 172.21.15.87:0/2871522318 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f79f0058c90 con 0x7f79f8141cf0 2024-05-09T08:02:03.301 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f79d806be30 msgr2=0x7f79d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f79d806be30 0x7f79d806e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79e8033000 tx=0x7f79e8009000 comp rx=0 tx=0).stop 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f8141cf0 msgr2=0x7f79f81439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f8141cf0 0x7f79f81439d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f79f000b410 tx=0x7f79f000b8d0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 shutdown_connections 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f79d806be30 0x7f79d806e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79f80b56f0 0x7f79f81e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f79f8141cf0 0x7f79f81439d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 --2- 172.21.15.87:0/2871522318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79f80b4dd0 0x7f79f81dd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 >> 172.21.15.87:0/2871522318 conn(0x7f79f80677b0 msgr2=0x7f79f8145c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:03.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 shutdown_connections 2024-05-09T08:02:03.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.286+0000 7f79fd163640 1 -- 172.21.15.87:0/2871522318 wait complete. 2024-05-09T08:02:03.315 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T08:02:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.401+0000 7fe872fb7640 1 Processor -- start 2024-05-09T08:02:03.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.401+0000 7fe872fb7640 1 -- start start 2024-05-09T08:02:03.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe872fb7640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe86c09b320 0x7fe86c1416c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe872fb7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c141c00 0x7fe86c14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe872fb7640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0675e0 con 0x7fe86c067200 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe872fb7640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe86c073940 con 0x7fe86c09b320 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe872fb7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe86c09b8b0 con 0x7fe86c141c00 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe86bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe86c09b320 0x7fe86c1416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe870d53640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe86c067200 0x7fe86c0b4830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60370/0 (socket says 172.21.15.87:60370) 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe870d53640 1 -- 172.21.15.87:0/1354231145 learned_addr learned my addr 172.21.15.87:0/1354231145 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe871554640 1 --2- 172.21.15.87:0/1354231145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c141c00 0x7fe86c14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe86bfff640 1 -- 172.21.15.87:0/1354231145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c141c00 msgr2=0x7fe86c14ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe86bfff640 1 --2- 172.21.15.87:0/1354231145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c141c00 0x7fe86c14ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe86bfff640 1 -- 172.21.15.87:0/1354231145 >> v1:172.21.15.87:6789/0 conn(0x7fe86c067200 legacy=0x7fe86c0b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe86b7fe640 1 -- 172.21.15.87:0/1354231145 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678821986 0 0) 0x7fe86c0675e0 con 0x7fe86c067200 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.402+0000 7fe86bfff640 1 -- 172.21.15.87:0/1354231145 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c09bb90 con 0x7fe86c09b320 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe86bfff640 1 --2- 172.21.15.87:0/1354231145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c09b320 0x7fe86c1416c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe8600097a0 tx=0x7fe86002a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79405f42fd5c96fc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:03.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe86b7fe640 1 -- 172.21.15.87:0/1354231145 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860037070 con 0x7fe86c09b320 2024-05-09T08:02:03.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe86b7fe640 1 -- 172.21.15.87:0/1354231145 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86002ae40 con 0x7fe86c09b320 2024-05-09T08:02:03.422 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe86b7fe640 1 -- 172.21.15.87:0/1354231145 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860032660 con 0x7fe86c09b320 2024-05-09T08:02:03.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe872fb7640 1 -- 172.21.15.87:0/1354231145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c09b320 msgr2=0x7fe86c1416c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe872fb7640 1 --2- 172.21.15.87:0/1354231145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c09b320 0x7fe86c1416c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe8600097a0 tx=0x7fe86002a0f0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe872fb7640 1 -- 172.21.15.87:0/1354231145 shutdown_connections 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe872fb7640 1 --2- 172.21.15.87:0/1354231145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c141c00 0x7fe86c14ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe872fb7640 1 --2- 172.21.15.87:0/1354231145 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c09b320 0x7fe86c1416c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.403+0000 7fe872fb7640 1 -- 172.21.15.87:0/1354231145 >> 172.21.15.87:0/1354231145 conn(0x7fe86c0b6190 msgr2=0x7fe86c0b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.404+0000 7fe872fb7640 1 -- 172.21.15.87:0/1354231145 shutdown_connections 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.404+0000 7fe872fb7640 1 -- 172.21.15.87:0/1354231145 wait complete. 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.404+0000 7fe872fb7640 1 Processor -- start 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe872fb7640 1 -- start start 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe872fb7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c067200 0x7fe86c144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe872fb7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe86c09b320 0x7fe86c1dd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe872fb7640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c141c00 0x7fe86c1dd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe872fb7640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c14b550 con 0x7fe86c141c00 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe872fb7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c14b3d0 con 0x7fe86c09b320 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe872fb7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe86c14b6d0 con 0x7fe86c067200 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe871554640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c141c00 0x7fe86c1dd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe871554640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c141c00 0x7fe86c1dd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44268/0 (socket says 172.21.15.87:44268) 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe871554640 1 -- 172.21.15.87:0/141302818 learned_addr learned my addr 172.21.15.87:0/141302818 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe870d53640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c067200 0x7fe86c144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe86bfff640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe86c09b320 0x7fe86c1dd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe871554640 1 -- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c067200 msgr2=0x7fe86c144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe871554640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c067200 0x7fe86c144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe871554640 1 -- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe86c09b320 msgr2=0x7fe86c1dd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe871554640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe86c09b320 0x7fe86c1dd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe871554640 1 -- 172.21.15.87:0/141302818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c13c030 con 0x7fe86c141c00 2024-05-09T08:02:03.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe86bfff640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe86c09b320 0x7fe86c1dd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.405+0000 7fe870d53640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c067200 0x7fe86c144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.406+0000 7fe871554640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c141c00 0x7fe86c1dd590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe86400d600 tx=0x7fe86400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.406+0000 7fe8697fa640 1 -- 172.21.15.87:0/141302818 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640125f0 con 0x7fe86c141c00 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.406+0000 7fe8697fa640 1 -- 172.21.15.87:0/141302818 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe864019070 con 0x7fe86c141c00 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.406+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c1447d0 con 0x7fe86c141c00 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.406+0000 7fe8697fa640 1 -- 172.21.15.87:0/141302818 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640129f0 con 0x7fe86c141c00 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.406+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c1422d0 con 0x7fe86c141c00 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.407+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c0691f0 con 0x7fe86c141c00 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.407+0000 7fe8697fa640 1 -- 172.21.15.87:0/141302818 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe864012b90 con 0x7fe86c141c00 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.408+0000 7fe8697fa640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe85806be60 0x7fe85806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.408+0000 7fe8697fa640 1 -- 172.21.15.87:0/141302818 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe86408b280 con 0x7fe86c141c00 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.408+0000 7fe870d53640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe85806be60 0x7fe85806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.408+0000 7fe870d53640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe85806be60 0x7fe85806e320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0012e0 tx=0x7fe85c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:03.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.412+0000 7fe8697fa640 1 -- 172.21.15.87:0/141302818 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe864059bb0 con 0x7fe86c141c00 2024-05-09T08:02:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.586+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe86c09c4a0 con 0x7fe86c141c00 2024-05-09T08:02:03.604 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.587+0000 7fe8697fa640 1 -- 172.21.15.87:0/141302818 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fe8640594b0 con 0x7fe86c141c00 2024-05-09T08:02:03.604 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-05-09T08:02:03.606 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.588+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe85806be60 msgr2=0x7fe85806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.588+0000 7fe872fb7640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe85806be60 0x7fe85806e320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0012e0 tx=0x7fe85c009040 comp rx=0 tx=0).stop 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.588+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c141c00 msgr2=0x7fe86c1dd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.588+0000 7fe872fb7640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c141c00 0x7fe86c1dd590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe86400d600 tx=0x7fe86400dac0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.589+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 shutdown_connections 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.589+0000 7fe872fb7640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe85806be60 0x7fe85806e320 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.589+0000 7fe872fb7640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe86c141c00 0x7fe86c1dd590 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.589+0000 7fe872fb7640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe86c09b320 0x7fe86c1dd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.589+0000 7fe872fb7640 1 --2- 172.21.15.87:0/141302818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe86c067200 0x7fe86c144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.589+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 >> 172.21.15.87:0/141302818 conn(0x7fe86c0b6190 msgr2=0x7fe86c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.589+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 shutdown_connections 2024-05-09T08:02:03.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.589+0000 7fe872fb7640 1 -- 172.21.15.87:0/141302818 wait complete. 2024-05-09T08:02:03.618 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T08:02:03.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.703+0000 7f7a830fc640 1 Processor -- start 2024-05-09T08:02:03.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.703+0000 7f7a830fc640 1 -- start start 2024-05-09T08:02:03.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a830fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7a7c0b6550 0x7f7a7c072c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a830fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a7c073140 0x7f7a7c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a830fc640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7c071430 con 0x7f7a7c146050 2024-05-09T08:02:03.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a830fc640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7c06fce0 con 0x7f7a7c0b6550 2024-05-09T08:02:03.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a830fc640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7c073580 con 0x7f7a7c073140 2024-05-09T08:02:03.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a80e98640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7a7c0b6550 0x7f7a7c072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a81699640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7a7c146050 0x7f7a7c148b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60380/0 (socket says 172.21.15.87:60380) 2024-05-09T08:02:03.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a81699640 1 -- 172.21.15.87:0/2503563086 learned_addr learned my addr 172.21.15.87:0/2503563086 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:03.722 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a7bfff640 1 --2- 172.21.15.87:0/2503563086 >> v2:172.21.15.110:3300/0 conn(0x7f7a7c073140 0x7f7a7c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a80e98640 1 -- 172.21.15.87:0/2503563086 >> v2:172.21.15.110:3300/0 conn(0x7f7a7c073140 msgr2=0x7f7a7c145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:03.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a80e98640 1 --2- 172.21.15.87:0/2503563086 >> v2:172.21.15.110:3300/0 conn(0x7f7a7c073140 0x7f7a7c145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a80e98640 1 -- 172.21.15.87:0/2503563086 >> v1:172.21.15.87:6789/0 conn(0x7f7a7c146050 legacy=0x7f7a7c148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a80e98640 1 -- 172.21.15.87:0/2503563086 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c0b6930 con 0x7f7a7c0b6550 2024-05-09T08:02:03.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.704+0000 7f7a7b7fe640 1 -- 172.21.15.87:0/2503563086 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741420609 0 0) 0x7f7a74001110 con 0x7f7a7c146050 2024-05-09T08:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a80e98640 1 --2- 172.21.15.87:0/2503563086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c0b6550 0x7f7a7c072c00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0b2970 tx=0x7f7a6c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d063f5b7e3a5956f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a7b7fe640 1 -- 172.21.15.87:0/2503563086 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c007740 con 0x7f7a7c0b6550 2024-05-09T08:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a7b7fe640 1 -- 172.21.15.87:0/2503563086 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6c0078e0 con 0x7f7a7c0b6550 2024-05-09T08:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a7b7fe640 1 -- 172.21.15.87:0/2503563086 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c007cb0 con 0x7f7a7c0b6550 2024-05-09T08:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a830fc640 1 -- 172.21.15.87:0/2503563086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c0b6550 msgr2=0x7f7a7c072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.726 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a830fc640 1 --2- 172.21.15.87:0/2503563086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c0b6550 0x7f7a7c072c00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0b2970 tx=0x7f7a6c02a5f0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a830fc640 1 -- 172.21.15.87:0/2503563086 shutdown_connections 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a830fc640 1 --2- 172.21.15.87:0/2503563086 >> v2:172.21.15.110:3300/0 conn(0x7f7a7c073140 0x7f7a7c145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a830fc640 1 --2- 172.21.15.87:0/2503563086 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c0b6550 0x7f7a7c072c00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.705+0000 7f7a830fc640 1 -- 172.21.15.87:0/2503563086 >> 172.21.15.87:0/2503563086 conn(0x7f7a7c0675c0 msgr2=0x7f7a7c0b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.706+0000 7f7a830fc640 1 -- 172.21.15.87:0/2503563086 shutdown_connections 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.706+0000 7f7a830fc640 1 -- 172.21.15.87:0/2503563086 wait complete. 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.706+0000 7f7a830fc640 1 Processor -- start 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.706+0000 7f7a830fc640 1 -- start start 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a830fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c073140 0x7f7a7c0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a830fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a7c0b6550 0x7f7a7c1db750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a830fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c146050 0x7f7a7c1dbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a830fc640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c070210 con 0x7f7a7c073140 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a830fc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c06ff30 con 0x7f7a7c146050 2024-05-09T08:02:03.727 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a830fc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7c146470 con 0x7f7a7c0b6550 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a80e98640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c073140 0x7f7a7c0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a80e98640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c073140 0x7f7a7c0acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44284/0 (socket says 172.21.15.87:44284) 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a80e98640 1 -- 172.21.15.87:0/3600403363 learned_addr learned my addr 172.21.15.87:0/3600403363 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a81699640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c146050 0x7f7a7c1dbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a7bfff640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a7c0b6550 0x7f7a7c1db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a80e98640 1 -- 172.21.15.87:0/3600403363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a7c0b6550 msgr2=0x7f7a7c1db750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a80e98640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a7c0b6550 0x7f7a7c1db750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a80e98640 1 -- 172.21.15.87:0/3600403363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c146050 msgr2=0x7f7a7c1dbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a80e98640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c146050 0x7f7a7c1dbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a80e98640 1 -- 172.21.15.87:0/3600403363 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c1cbac0 con 0x7f7a7c073140 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.707+0000 7f7a81699640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c146050 0x7f7a7c1dbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.708+0000 7f7a80e98640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c073140 0x7f7a7c0acff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c02abe0 tx=0x7f7a6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.708+0000 7f7a797fa640 1 -- 172.21.15.87:0/3600403363 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c040070 con 0x7f7a7c073140 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.708+0000 7f7a797fa640 1 -- 172.21.15.87:0/3600403363 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6c031c40 con 0x7f7a7c073140 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.708+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7c0ae580 con 0x7f7a7c073140 2024-05-09T08:02:03.728 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.708+0000 7f7a797fa640 1 -- 172.21.15.87:0/3600403363 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c03c420 con 0x7f7a7c073140 2024-05-09T08:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.708+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7c1db230 con 0x7f7a7c073140 2024-05-09T08:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.709+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a7c0691f0 con 0x7f7a7c073140 2024-05-09T08:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.709+0000 7f7a797fa640 1 -- 172.21.15.87:0/3600403363 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a6c039040 con 0x7f7a7c073140 2024-05-09T08:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.710+0000 7f7a797fa640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f7a6806be30 0x7f7a6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:03.729 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.710+0000 7f7a797fa640 1 -- 172.21.15.87:0/3600403363 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f7a6c0ac3d0 con 0x7f7a7c073140 2024-05-09T08:02:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.710+0000 7f7a7bfff640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f7a6806be30 0x7f7a6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:03.730 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.710+0000 7f7a7bfff640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f7a6806be30 0x7f7a6806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a70006fd0 tx=0x7f7a70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:03.731 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.714+0000 7f7a797fa640 1 -- 172.21.15.87:0/3600403363 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7a6c07ad80 con 0x7f7a7c073140 2024-05-09T08:02:03.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.888+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7a7c143e70 con 0x7f7a7c073140 2024-05-09T08:02:03.907 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.888+0000 7f7a797fa640 1 -- 172.21.15.87:0/3600403363 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f7a6c07a680 con 0x7f7a7c073140 2024-05-09T08:02:03.908 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-05-09T08:02:03.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f7a6806be30 msgr2=0x7f7a6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.908 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f7a6806be30 0x7f7a6806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a70006fd0 tx=0x7f7a70008040 comp rx=0 tx=0).stop 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c073140 msgr2=0x7f7a7c0acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c073140 0x7f7a7c0acff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c02abe0 tx=0x7f7a6c004a40 comp rx=0 tx=0).stop 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 shutdown_connections 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f7a6806be30 0x7f7a6806e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a7c0b6550 0x7f7a7c1db750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c146050 0x7f7a7c1dbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 --2- 172.21.15.87:0/3600403363 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7a7c073140 0x7f7a7c0acff0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 >> 172.21.15.87:0/3600403363 conn(0x7f7a7c0675c0 msgr2=0x7f7a7c074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 shutdown_connections 2024-05-09T08:02:03.909 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:03.890+0000 7f7a830fc640 1 -- 172.21.15.87:0/3600403363 wait complete. 2024-05-09T08:02:03.920 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T08:02:04.021 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.004+0000 7f921b963640 1 Processor -- start 2024-05-09T08:02:04.022 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.004+0000 7f921b963640 1 -- start start 2024-05-09T08:02:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.004+0000 7f921b963640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f921409b320 0x7f92141416c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.004+0000 7f921b963640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9214141c00 0x7f921414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.004+0000 7f921b963640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92140675e0 con 0x7f9214067200 2024-05-09T08:02:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.004+0000 7f921b963640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9214073940 con 0x7f921409b320 2024-05-09T08:02:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.004+0000 7f921b963640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f921409b8b0 con 0x7f9214141c00 2024-05-09T08:02:04.024 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f92196ff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9214067200 0x7f92140b4830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60386/0 (socket says 172.21.15.87:60386) 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f92196ff640 1 -- 172.21.15.87:0/1475507896 learned_addr learned my addr 172.21.15.87:0/1475507896 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f9218efe640 1 --2- 172.21.15.87:0/1475507896 >> v2:172.21.15.87:3300/0 conn(0x7f921409b320 0x7f92141416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f9219f00640 1 --2- 172.21.15.87:0/1475507896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9214141c00 0x7f921414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f9207fff640 1 -- 172.21.15.87:0/1475507896 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503372884 0 0) 0x7f92140675e0 con 0x7f9214067200 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f9207fff640 1 -- 172.21.15.87:0/1475507896 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9200003520 con 0x7f9214067200 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f9218efe640 1 -- 172.21.15.87:0/1475507896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9214141c00 msgr2=0x7f921414ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f9218efe640 1 --2- 172.21.15.87:0/1475507896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9214141c00 0x7f921414ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f9218efe640 1 -- 172.21.15.87:0/1475507896 >> v1:172.21.15.87:6789/0 conn(0x7f9214067200 legacy=0x7f92140b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.005+0000 7f9218efe640 1 -- 172.21.15.87:0/1475507896 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921409bb90 con 0x7f921409b320 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f9218efe640 1 --2- 172.21.15.87:0/1475507896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f921409b320 0x7f92141416c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92100097a0 tx=0x7f921002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33498fad77ca088f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f9207fff640 1 -- 172.21.15.87:0/1475507896 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210037070 con 0x7f921409b320 2024-05-09T08:02:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f9207fff640 1 -- 172.21.15.87:0/1475507896 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921002ae50 con 0x7f921409b320 2024-05-09T08:02:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f9207fff640 1 -- 172.21.15.87:0/1475507896 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210032660 con 0x7f921409b320 2024-05-09T08:02:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f921b963640 1 -- 172.21.15.87:0/1475507896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f921409b320 msgr2=0x7f92141416c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f921b963640 1 --2- 172.21.15.87:0/1475507896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f921409b320 0x7f92141416c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92100097a0 tx=0x7f921002a100 comp rx=0 tx=0).stop 2024-05-09T08:02:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f921b963640 1 -- 172.21.15.87:0/1475507896 shutdown_connections 2024-05-09T08:02:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f921b963640 1 --2- 172.21.15.87:0/1475507896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9214141c00 0x7f921414ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f921b963640 1 --2- 172.21.15.87:0/1475507896 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f921409b320 0x7f92141416c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f921b963640 1 -- 172.21.15.87:0/1475507896 >> 172.21.15.87:0/1475507896 conn(0x7f92140b6190 msgr2=0x7f92140b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f921b963640 1 -- 172.21.15.87:0/1475507896 shutdown_connections 2024-05-09T08:02:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.006+0000 7f921b963640 1 -- 172.21.15.87:0/1475507896 wait complete. 2024-05-09T08:02:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.007+0000 7f921b963640 1 Processor -- start 2024-05-09T08:02:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.007+0000 7f921b963640 1 -- start start 2024-05-09T08:02:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f921b963640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9214067200 0x7f92141475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f921b963640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921409b320 0x7f921413de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f921b963640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9214141c00 0x7f921413e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f921b963640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f921414b550 con 0x7f9214067200 2024-05-09T08:02:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f921b963640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f921414b3d0 con 0x7f9214141c00 2024-05-09T08:02:04.029 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f921b963640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f921414b6d0 con 0x7f921409b320 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f92196ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9214067200 0x7f92141475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f92196ff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9214067200 0x7f92141475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44306/0 (socket says 172.21.15.87:44306) 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f92196ff640 1 -- 172.21.15.87:0/3489153367 learned_addr learned my addr 172.21.15.87:0/3489153367 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f9219f00640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9214141c00 0x7f921413e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f9218efe640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921409b320 0x7f921413de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f92196ff640 1 -- 172.21.15.87:0/3489153367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921409b320 msgr2=0x7f921413de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f92196ff640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921409b320 0x7f921413de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f92196ff640 1 -- 172.21.15.87:0/3489153367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9214141c00 msgr2=0x7f921413e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f92196ff640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9214141c00 0x7f921413e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f92196ff640 1 -- 172.21.15.87:0/3489153367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92140709b0 con 0x7f9214067200 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f9219f00640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9214141c00 0x7f921413e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f92196ff640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9214067200 0x7f92141475c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f920800c430 tx=0x7f920800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:04.030 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.008+0000 7f9205ffb640 1 -- 172.21.15.87:0/3489153367 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208017070 con 0x7f9214067200 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.009+0000 7f9205ffb640 1 -- 172.21.15.87:0/3489153367 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208005ce0 con 0x7f9214067200 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.009+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9214070f00 con 0x7f9214067200 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.009+0000 7f9205ffb640 1 -- 172.21.15.87:0/3489153367 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92080072f0 con 0x7f9214067200 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.009+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f921413d550 con 0x7f9214067200 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.009+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92140732e0 con 0x7f9214067200 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.010+0000 7f9205ffb640 1 -- 172.21.15.87:0/3489153367 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f920801a070 con 0x7f9214067200 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.010+0000 7f9205ffb640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f91f806be30 0x7f91f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.011+0000 7f9205ffb640 1 -- 172.21.15.87:0/3489153367 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f920808a360 con 0x7f9214067200 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.011+0000 7f9218efe640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f91f806be30 0x7f91f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.031 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.011+0000 7f9218efe640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f91f806be30 0x7f91f806e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9210034000 tx=0x7f921002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:04.032 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.015+0000 7f9205ffb640 1 -- 172.21.15.87:0/3489153367 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f92140732e0 con 0x7f9214067200 2024-05-09T08:02:04.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.202+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f92140b5bc0 con 0x7f9214067200 2024-05-09T08:02:04.220 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.203+0000 7f9205ffb640 1 -- 172.21.15.87:0/3489153367 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f92140b5bc0 con 0x7f9214067200 2024-05-09T08:02:04.221 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f91f806be30 msgr2=0x7f91f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f91f806be30 0x7f91f806e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9210034000 tx=0x7f921002e000 comp rx=0 tx=0).stop 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9214067200 msgr2=0x7f92141475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9214067200 0x7f92141475c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f920800c430 tx=0x7f920800c8f0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 shutdown_connections 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f91f806be30 0x7f91f806e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f921409b320 0x7f921413de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9214141c00 0x7f921413e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 --2- 172.21.15.87:0/3489153367 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9214067200 0x7f92141475c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 >> 172.21.15.87:0/3489153367 conn(0x7f92140b6190 msgr2=0x7f921406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 shutdown_connections 2024-05-09T08:02:04.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.205+0000 7f921b963640 1 -- 172.21.15.87:0/3489153367 wait complete. 2024-05-09T08:02:04.234 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-05-09T08:02:04.234 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T08:02:04.250 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T08:02:04.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.371+0000 7f813a31b640 1 Processor -- start 2024-05-09T08:02:04.389 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.371+0000 7f813a31b640 1 -- start start 2024-05-09T08:02:04.391 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f813a31b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81340b5e60 0x7f81340b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f813a31b640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f81340b2940 0x7f8134147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f813a31b640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81340b6240 con 0x7f81340b5330 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f813a31b640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f81340b0470 con 0x7f81340b2940 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f813a31b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f81340b1580 con 0x7f81340b5e60 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f81337fe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f81340b5330 0x7f81340b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60402/0 (socket says 172.21.15.87:60402) 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f81337fe640 1 -- 172.21.15.87:0/1670001347 learned_addr learned my addr 172.21.15.87:0/1670001347 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f81388b8640 1 --2- 172.21.15.87:0/1670001347 >> v2:172.21.15.87:3300/0 conn(0x7f81340b2940 0x7f8134147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f8133fff640 1 --2- 172.21.15.87:0/1670001347 >> v2:172.21.15.110:3300/0 conn(0x7f81340b5e60 0x7f81340b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f81388b8640 1 -- 172.21.15.87:0/1670001347 >> v2:172.21.15.110:3300/0 conn(0x7f81340b5e60 msgr2=0x7f81340b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f81388b8640 1 --2- 172.21.15.87:0/1670001347 >> v2:172.21.15.110:3300/0 conn(0x7f81340b5e60 0x7f81340b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f81388b8640 1 -- 172.21.15.87:0/1670001347 >> v1:172.21.15.87:6789/0 conn(0x7f81340b5330 legacy=0x7f81340b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f81388b8640 1 -- 172.21.15.87:0/1670001347 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81340b1860 con 0x7f81340b2940 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.372+0000 7f8133fff640 1 --2- 172.21.15.87:0/1670001347 >> v2:172.21.15.110:3300/0 conn(0x7f81340b5e60 0x7f81340b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:04.392 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.373+0000 7f81388b8640 1 --2- 172.21.15.87:0/1670001347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b2940 0x7f8134147bd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f813406dc50 tx=0x7f812c02c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17d86cf4a488ddb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.373+0000 7f8132ffd640 1 -- 172.21.15.87:0/1670001347 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c007740 con 0x7f81340b2940 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.373+0000 7f8132ffd640 1 -- 172.21.15.87:0/1670001347 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c0078e0 con 0x7f81340b2940 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.373+0000 7f8132ffd640 1 -- 172.21.15.87:0/1670001347 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c007cb0 con 0x7f81340b2940 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.374+0000 7f813a31b640 1 -- 172.21.15.87:0/1670001347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b2940 msgr2=0x7f8134147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.374+0000 7f813a31b640 1 --2- 172.21.15.87:0/1670001347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b2940 0x7f8134147bd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f813406dc50 tx=0x7f812c02c820 comp rx=0 tx=0).stop 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.374+0000 7f813a31b640 1 -- 172.21.15.87:0/1670001347 shutdown_connections 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.374+0000 7f813a31b640 1 --2- 172.21.15.87:0/1670001347 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b2940 0x7f8134147bd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.374+0000 7f813a31b640 1 --2- 172.21.15.87:0/1670001347 >> v2:172.21.15.110:3300/0 conn(0x7f81340b5e60 0x7f81340b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.374+0000 7f813a31b640 1 -- 172.21.15.87:0/1670001347 >> 172.21.15.87:0/1670001347 conn(0x7f813406c6a0 msgr2=0x7f813406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.374+0000 7f813a31b640 1 -- 172.21.15.87:0/1670001347 shutdown_connections 2024-05-09T08:02:04.393 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.374+0000 7f813a31b640 1 -- 172.21.15.87:0/1670001347 wait complete. 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.375+0000 7f813a31b640 1 Processor -- start 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.375+0000 7f813a31b640 1 -- start start 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.375+0000 7f813a31b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81340b2940 0x7f813413d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.375+0000 7f813a31b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b5330 0x7f813413ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.375+0000 7f813a31b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81340b5e60 0x7f8134137f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.375+0000 7f813a31b640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f81340afae0 con 0x7f81340b5330 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.375+0000 7f813a31b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f81340af960 con 0x7f81340b2940 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.375+0000 7f813a31b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8134148110 con 0x7f81340b5e60 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.375+0000 7f81337fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b5330 0x7f813413ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81337fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b5330 0x7f813413ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44316/0 (socket says 172.21.15.87:44316) 2024-05-09T08:02:04.397 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81337fe640 1 -- 172.21.15.87:0/1286897878 learned_addr learned my addr 172.21.15.87:0/1286897878 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f8133fff640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81340b2940 0x7f813413d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81388b8640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81340b5e60 0x7f8134137f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81337fe640 1 -- 172.21.15.87:0/1286897878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81340b5e60 msgr2=0x7f8134137f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81337fe640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81340b5e60 0x7f8134137f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81337fe640 1 -- 172.21.15.87:0/1286897878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81340b2940 msgr2=0x7f813413d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81337fe640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81340b2940 0x7f813413d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81337fe640 1 -- 172.21.15.87:0/1286897878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813406ff30 con 0x7f81340b5330 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81388b8640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81340b5e60 0x7f8134137f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f81337fe640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b5330 0x7f813413ec10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f812800c4a0 tx=0x7f812800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f8130ff9640 1 -- 172.21.15.87:0/1286897878 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128017070 con 0x7f81340b5330 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f8130ff9640 1 -- 172.21.15.87:0/1286897878 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128005ce0 con 0x7f81340b5330 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813413c930 con 0x7f81340b5330 2024-05-09T08:02:04.398 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f8130ff9640 1 -- 172.21.15.87:0/1286897878 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128007270 con 0x7f81340b5330 2024-05-09T08:02:04.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.376+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81341446d0 con 0x7f81340b5330 2024-05-09T08:02:04.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.377+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81340691f0 con 0x7f81340b5330 2024-05-09T08:02:04.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.378+0000 7f8130ff9640 1 -- 172.21.15.87:0/1286897878 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f812801a070 con 0x7f81340b5330 2024-05-09T08:02:04.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.378+0000 7f8130ff9640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f812006be30 0x7f812006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.378+0000 7f8130ff9640 1 -- 172.21.15.87:0/1286897878 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f812808a0c0 con 0x7f81340b5330 2024-05-09T08:02:04.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.378+0000 7f8133fff640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f812006be30 0x7f812006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.378+0000 7f8133fff640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f812006be30 0x7f812006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8124006fd0 tx=0x7f8124008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:04.399 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.382+0000 7f8130ff9640 1 -- 172.21.15.87:0/1286897878 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8128058420 con 0x7f81340b5330 2024-05-09T08:02:04.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.558+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81340b24e0 con 0x7f81340b5330 2024-05-09T08:02:04.576 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.559+0000 7f8130ff9640 1 -- 172.21.15.87:0/1286897878 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16820 (secure 0 0 0) 0x7f812805c720 con 0x7f81340b5330 2024-05-09T08:02:04.577 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:04.577 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:55:18.551072+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T08:02:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f812006be30 msgr2=0x7f812006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f812006be30 0x7f812006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8124006fd0 tx=0x7f8124008040 comp rx=0 tx=0).stop 2024-05-09T08:02:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b5330 msgr2=0x7f813413ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b5330 0x7f813413ec10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f812800c4a0 tx=0x7f812800c960 comp rx=0 tx=0).stop 2024-05-09T08:02:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 shutdown_connections 2024-05-09T08:02:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f812006be30 0x7f812006e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81340b5e60 0x7f8134137f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f81340b5330 0x7f813413ec10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.579 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 --2- 172.21.15.87:0/1286897878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81340b2940 0x7f813413d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 >> 172.21.15.87:0/1286897878 conn(0x7f813406c6a0 msgr2=0x7f81340ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 shutdown_connections 2024-05-09T08:02:04.580 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.561+0000 7f813a31b640 1 -- 172.21.15.87:0/1286897878 wait complete. 2024-05-09T08:02:04.590 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T07:54:24.920922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T07:54:34.879628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T07:54:35.405648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T08:02:04.591 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T08:02:04.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.677+0000 7f6942b42640 1 Processor -- start 2024-05-09T08:02:04.695 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.677+0000 7f6942b42640 1 -- start start 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.678+0000 7f6942b42640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f693c148400 0x7f693c141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.678+0000 7f6942b42640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693c0b4780 con 0x7f693c1417b0 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.678+0000 7f6942b42640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693c0b5e20 con 0x7f693c0b4dd0 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.678+0000 7f6942b42640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f693c142150 con 0x7f693c148400 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.678+0000 7f693bfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f693c1417b0 0x7f693c147cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60414/0 (socket says 172.21.15.87:60414) 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.678+0000 7f693bfff640 1 -- 172.21.15.87:0/1531395662 learned_addr learned my addr 172.21.15.87:0/1531395662 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.678+0000 7f69410df640 1 --2- 172.21.15.87:0/1531395662 >> v2:172.21.15.110:3300/0 conn(0x7f693c148400 0x7f693c141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.678+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090401765 0 0) 0x7f693c0b4780 con 0x7f693c1417b0 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.678+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6928003520 con 0x7f693c1417b0 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3014374663 0 0) 0x7f6928003520 con 0x7f693c1417b0 2024-05-09T08:02:04.699 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 >> v2:172.21.15.110:3300/0 conn(0x7f693c148400 msgr2=0x7f693c141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 --2- 172.21.15.87:0/1531395662 >> v2:172.21.15.110:3300/0 conn(0x7f693c148400 0x7f693c141c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 >> v1:172.21.15.110:6789/0 conn(0x7f693c0b4dd0 legacy=0x7f693c0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c0b6090 con 0x7f693c1417b0 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f6924001670 con 0x7f693c1417b0 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 >> v1:172.21.15.87:6789/0 conn(0x7f693c1417b0 legacy=0x7f693c147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f6928003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6928004800 0x7f6928004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69280051c0 0x7f692800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f693c142150 con 0x7f69280039b0 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f692800c160 con 0x7f69280051c0 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f692800c360 con 0x7f6928004800 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f69408de640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f6928003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693bfff640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6928004800 0x7f6928004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f69410df640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69280051c0 0x7f692800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.700 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f69408de640 1 -- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6928004800 msgr2=0x7f6928004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f69408de640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6928004800 0x7f6928004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f69408de640 1 -- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69280051c0 msgr2=0x7f692800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f69408de640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69280051c0 0x7f692800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f69408de640 1 -- 172.21.15.87:0/1531395662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6928003520 con 0x7f69280039b0 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f69410df640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69280051c0 0x7f692800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f693bfff640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6928004800 0x7f6928004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.679+0000 7f69410df640 1 -- 172.21.15.87:0/1531395662 reap_dead start 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f69408de640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f6928003dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f692c001e50 tx=0x7f6928005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86fe52d12a11062 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c001a70 con 0x7f69280039b0 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c02ae40 con 0x7f69280039b0 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f693b7fe640 1 -- 172.21.15.87:0/1531395662 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c003bb0 con 0x7f69280039b0 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f6942b42640 1 -- 172.21.15.87:0/1531395662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 msgr2=0x7f6928003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f6942b42640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f6928003dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f692c001e50 tx=0x7f6928005830 comp rx=0 tx=0).stop 2024-05-09T08:02:04.701 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f6942b42640 1 -- 172.21.15.87:0/1531395662 shutdown_connections 2024-05-09T08:02:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f6942b42640 1 --2- 172.21.15.87:0/1531395662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f6928003dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f6942b42640 1 -- 172.21.15.87:0/1531395662 >> 172.21.15.87:0/1531395662 conn(0x7f693c0677b0 msgr2=0x7f693c0bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f6942b42640 1 -- 172.21.15.87:0/1531395662 shutdown_connections 2024-05-09T08:02:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.680+0000 7f6942b42640 1 -- 172.21.15.87:0/1531395662 wait complete. 2024-05-09T08:02:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.681+0000 7f6942b42640 1 Processor -- start 2024-05-09T08:02:04.702 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.681+0000 7f6942b42640 1 -- start start 2024-05-09T08:02:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f6942b42640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f693c13fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f6942b42640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f693c14a190 0x7f693c14a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f6942b42640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f693c1e0400 0x7f693c1e0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f6942b42640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f693c0b4200 con 0x7f69280039b0 2024-05-09T08:02:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f6942b42640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f693c0b4080 con 0x7f693c14a190 2024-05-09T08:02:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f6942b42640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f693c141c10 con 0x7f693c1e0400 2024-05-09T08:02:04.704 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f69408de640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f693c13fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f69408de640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f693c13fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44334/0 (socket says 172.21.15.87:44334) 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f69408de640 1 -- 172.21.15.87:0/1655102196 learned_addr learned my addr 172.21.15.87:0/1655102196 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f69408de640 1 -- 172.21.15.87:0/1655102196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f693c1e0400 msgr2=0x7f693c1e0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f69408de640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f693c1e0400 0x7f693c1e0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f69408de640 1 -- 172.21.15.87:0/1655102196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f693c14a190 msgr2=0x7f693c14a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f69408de640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f693c14a190 0x7f693c14a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.682+0000 7f69408de640 1 -- 172.21.15.87:0/1655102196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c14ab50 con 0x7f69280039b0 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.683+0000 7f69408de640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f693c13fe50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f692c001f70 tx=0x7f692c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.683+0000 7f69397fa640 1 -- 172.21.15.87:0/1655102196 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c040030 con 0x7f69280039b0 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.683+0000 7f69397fa640 1 -- 172.21.15.87:0/1655102196 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c02ac40 con 0x7f69280039b0 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.683+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693c14bc80 con 0x7f69280039b0 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.683+0000 7f69397fa640 1 -- 172.21.15.87:0/1655102196 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c007db0 con 0x7f69280039b0 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.683+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f693c14b6c0 con 0x7f69280039b0 2024-05-09T08:02:04.705 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.684+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693c13df80 con 0x7f69280039b0 2024-05-09T08:02:04.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.684+0000 7f69397fa640 1 -- 172.21.15.87:0/1655102196 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f692c043070 con 0x7f69280039b0 2024-05-09T08:02:04.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.685+0000 7f69397fa640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f691c06be30 0x7f691c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:04.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.685+0000 7f69397fa640 1 -- 172.21.15.87:0/1655102196 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f692c0aaf00 con 0x7f69280039b0 2024-05-09T08:02:04.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.685+0000 7f693bfff640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f691c06be30 0x7f691c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:04.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.685+0000 7f693bfff640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f691c06be30 0x7f691c06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6924001eb0 tx=0x7f6924001150 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:04.706 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.689+0000 7f69397fa640 1 -- 172.21.15.87:0/1655102196 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f693c13df80 con 0x7f69280039b0 2024-05-09T08:02:04.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.862+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f693c143210 con 0x7f69280039b0 2024-05-09T08:02:04.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.862+0000 7f69397fa640 1 -- 172.21.15.87:0/1655102196 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f693c14ab50 con 0x7f69280039b0 2024-05-09T08:02:04.880 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f691c06be30 msgr2=0x7f691c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f691c06be30 0x7f691c06e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6924001eb0 tx=0x7f6924001150 comp rx=0 tx=0).stop 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 msgr2=0x7f693c13fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f693c13fe50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f692c001f70 tx=0x7f692c0014a0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 shutdown_connections 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f691c06be30 0x7f691c06e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f693c1e0400 0x7f693c1e0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f693c14a190 0x7f693c14a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 --2- 172.21.15.87:0/1655102196 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f69280039b0 0x7f693c13fe50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:04.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 >> 172.21.15.87:0/1655102196 conn(0x7f693c0677b0 msgr2=0x7f693c13d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:04.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 shutdown_connections 2024-05-09T08:02:04.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.864+0000 7f6942b42640 1 -- 172.21.15.87:0/1655102196 wait complete. 2024-05-09T08:02:04.893 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T08:02:04.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.979+0000 7f5d0d9ab640 1 Processor -- start 2024-05-09T08:02:04.997 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.979+0000 7f5d0d9ab640 1 -- start start 2024-05-09T08:02:05.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d0d9ab640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d08148400 0x7f5d08141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d0d9ab640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d080b4780 con 0x7f5d080b4dd0 2024-05-09T08:02:05.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d0d9ab640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d080b5e20 con 0x7f5d081417b0 2024-05-09T08:02:05.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d0d9ab640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5d08142150 con 0x7f5d08148400 2024-05-09T08:02:05.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d06ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f5d080b4dd0 0x7f5d080b51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60424/0 (socket says 172.21.15.87:60424) 2024-05-09T08:02:05.000 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d06ffd640 1 -- 172.21.15.87:0/2754031334 learned_addr learned my addr 172.21.15.87:0/2754031334 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942219864 0 0) 0x7f5d080b4780 con 0x7f5d080b4dd0 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cf0003520 con 0x7f5d080b4dd0 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d077fe640 1 --2- 172.21.15.87:0/2754031334 >> v2:172.21.15.110:3300/0 conn(0x7f5d08148400 0x7f5d08141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2905368689 0 0) 0x7f5cf0003520 con 0x7f5d080b4dd0 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 >> v2:172.21.15.110:3300/0 conn(0x7f5d08148400 msgr2=0x7f5d08141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 --2- 172.21.15.87:0/2754031334 >> v2:172.21.15.110:3300/0 conn(0x7f5d08148400 0x7f5d08141c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 >> v1:172.21.15.110:6789/0 conn(0x7f5d081417b0 legacy=0x7f5d08147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d080b6090 con 0x7f5d080b4dd0 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f5cf8001670 con 0x7f5d080b4dd0 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 >> v1:172.21.15.87:6789/0 conn(0x7f5d080b4dd0 legacy=0x7f5d080b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.980+0000 7f5d05ffb640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.001 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d05ffb640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cf0004800 0x7f5cf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d05ffb640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf00051c0 0x7f5cf000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08142150 con 0x7f5cf00039b0 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf000c160 con 0x7f5cf00051c0 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf000c360 con 0x7f5cf0004800 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d06ffd640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d077fe640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf00051c0 0x7f5cf000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d067fc640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cf0004800 0x7f5cf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d06ffd640 1 -- 172.21.15.87:0/2754031334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cf0004800 msgr2=0x7f5cf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d06ffd640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cf0004800 0x7f5cf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d06ffd640 1 -- 172.21.15.87:0/2754031334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf00051c0 msgr2=0x7f5cf000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d06ffd640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf00051c0 0x7f5cf000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d077fe640 1 -- 172.21.15.87:0/2754031334 reap_dead start 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.981+0000 7f5d06ffd640 1 -- 172.21.15.87:0/2754031334 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf0003520 con 0x7f5cf00039b0 2024-05-09T08:02:05.002 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d06ffd640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800c240 tx=0x7f5cf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6eab995dcd3de1e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8007d10 con 0x7f5cf00039b0 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf8005ad0 con 0x7f5cf00039b0 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d05ffb640 1 -- 172.21.15.87:0/2754031334 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8007070 con 0x7f5cf00039b0 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/2754031334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf00039b0 msgr2=0x7f5cf0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d0d9ab640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800c240 tx=0x7f5cf0005830 comp rx=0 tx=0).stop 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/2754031334 shutdown_connections 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d0d9ab640 1 --2- 172.21.15.87:0/2754031334 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5cf00039b0 0x7f5cf0003dd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/2754031334 >> 172.21.15.87:0/2754031334 conn(0x7f5d080677b0 msgr2=0x7f5d080bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/2754031334 shutdown_connections 2024-05-09T08:02:05.003 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.982+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/2754031334 wait complete. 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.983+0000 7f5d0d9ab640 1 Processor -- start 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d0d9ab640 1 -- start start 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d0d9ab640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf00039b0 0x7f5d0813fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d0d9ab640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d081e0fe0 0x7f5d081e1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d0d9ab640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d081dda70 0x7f5d081ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d0d9ab640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080b4200 con 0x7f5d081e0fe0 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d0d9ab640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080b4080 con 0x7f5cf00039b0 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d0d9ab640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5d08141c10 con 0x7f5d081dda70 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d067fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d081e0fe0 0x7f5d081e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d067fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d081e0fe0 0x7f5d081e1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44342/0 (socket says 172.21.15.87:44342) 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d067fc640 1 -- 172.21.15.87:0/955694689 learned_addr learned my addr 172.21.15.87:0/955694689 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d06ffd640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf00039b0 0x7f5d0813fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.984+0000 7f5d077fe640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d081dda70 0x7f5d081ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.006 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5d067fc640 1 -- 172.21.15.87:0/955694689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d081dda70 msgr2=0x7f5d081ddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5d067fc640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d081dda70 0x7f5d081ddef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5d067fc640 1 -- 172.21.15.87:0/955694689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf00039b0 msgr2=0x7f5d0813fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5d067fc640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf00039b0 0x7f5d0813fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5d067fc640 1 -- 172.21.15.87:0/955694689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d08143740 con 0x7f5d081e0fe0 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5d067fc640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d081e0fe0 0x7f5d081e1440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00f620 tx=0x7f5cfc00fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5ceffff640 1 -- 172.21.15.87:0/955694689 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0052e0 con 0x7f5d081e0fe0 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5ceffff640 1 -- 172.21.15.87:0/955694689 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc018070 con 0x7f5d081e0fe0 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d08139530 con 0x7f5d081e0fe0 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5ceffff640 1 -- 172.21.15.87:0/955694689 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc003810 con 0x7f5d081e0fe0 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.985+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d08140b10 con 0x7f5d081e0fe0 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.986+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d080691f0 con 0x7f5d081e0fe0 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.986+0000 7f5ceffff640 1 -- 172.21.15.87:0/955694689 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cfc0039b0 con 0x7f5d081e0fe0 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.987+0000 7f5ceffff640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5cf406be60 0x7f5cf406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.987+0000 7f5ceffff640 1 -- 172.21.15.87:0/955694689 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f5cfc08ac30 con 0x7f5d081e0fe0 2024-05-09T08:02:05.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.987+0000 7f5d06ffd640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5cf406be60 0x7f5cf406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.987+0000 7f5d06ffd640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5cf406be60 0x7f5cf406e320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8032000 tx=0x7f5cf8034040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:05.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:04.991+0000 7f5ceffff640 1 -- 172.21.15.87:0/955694689 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5cfc0595e0 con 0x7f5d081e0fe0 2024-05-09T08:02:05.186 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.169+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5d081e0940 con 0x7f5d081e0fe0 2024-05-09T08:02:05.187 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.169+0000 7f5ceffff640 1 -- 172.21.15.87:0/955694689 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f5cfc058ee0 con 0x7f5d081e0fe0 2024-05-09T08:02:05.187 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 32 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5cf406be60 msgr2=0x7f5cf406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5cf406be60 0x7f5cf406e320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8032000 tx=0x7f5cf8034040 comp rx=0 tx=0).stop 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d081e0fe0 msgr2=0x7f5d081e1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d081e0fe0 0x7f5d081e1440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00f620 tx=0x7f5cfc00fae0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 shutdown_connections 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5cf406be60 0x7f5cf406e320 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d081dda70 0x7f5d081ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5d081e0fe0 0x7f5d081e1440 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 --2- 172.21.15.87:0/955694689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cf00039b0 0x7f5d0813fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.189 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 >> 172.21.15.87:0/955694689 conn(0x7f5d080677b0 msgr2=0x7f5d0813d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 shutdown_connections 2024-05-09T08:02:05.190 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.171+0000 7f5d0d9ab640 1 -- 172.21.15.87:0/955694689 wait complete. 2024-05-09T08:02:05.200 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T08:02:05.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.285+0000 7fdef75ee640 1 Processor -- start 2024-05-09T08:02:05.303 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.285+0000 7fdef75ee640 1 -- start start 2024-05-09T08:02:05.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.286+0000 7fdef75ee640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdef00b4dd0 0x7fdef00b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.286+0000 7fdef75ee640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef00b4780 con 0x7fdef0141ec0 2024-05-09T08:02:05.304 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.286+0000 7fdef75ee640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef00b5e20 con 0x7fdef00b56f0 2024-05-09T08:02:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.286+0000 7fdef75ee640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fdef00b6090 con 0x7fdef00b4dd0 2024-05-09T08:02:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.286+0000 7fdef538a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdef00b4dd0 0x7fdef00b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.286+0000 7fdef5b8b640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdef0141ec0 0x7fdef0147cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:60440/0 (socket says 172.21.15.87:60440) 2024-05-09T08:02:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.286+0000 7fdef5b8b640 1 -- 172.21.15.87:0/1031178717 learned_addr learned my addr 172.21.15.87:0/1031178717 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.287+0000 7fdef538a640 1 -- 172.21.15.87:0/1031178717 >> v1:172.21.15.110:6789/0 conn(0x7fdef00b56f0 legacy=0x7fdef01417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.287+0000 7fdef538a640 1 -- 172.21.15.87:0/1031178717 >> v1:172.21.15.87:6789/0 conn(0x7fdef0141ec0 legacy=0x7fdef0147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.287+0000 7fdef538a640 1 -- 172.21.15.87:0/1031178717 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef00b6370 con 0x7fdef00b4dd0 2024-05-09T08:02:05.305 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.287+0000 7fdef538a640 1 --2- 172.21.15.87:0/1031178717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 0x7fdef00b51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdee00097a0 tx=0x7fdee002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32868fc5f678985c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:05.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdeeffff640 1 -- 172.21.15.87:0/1031178717 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0037070 con 0x7fdef00b4dd0 2024-05-09T08:02:05.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdeeffff640 1 -- 172.21.15.87:0/1031178717 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee0032440 con 0x7fdef00b4dd0 2024-05-09T08:02:05.306 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdeeffff640 1 -- 172.21.15.87:0/1031178717 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0032810 con 0x7fdef00b4dd0 2024-05-09T08:02:05.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdef75ee640 1 -- 172.21.15.87:0/1031178717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 msgr2=0x7fdef00b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdef75ee640 1 --2- 172.21.15.87:0/1031178717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 0x7fdef00b51b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdee00097a0 tx=0x7fdee002a1a0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdef75ee640 1 -- 172.21.15.87:0/1031178717 shutdown_connections 2024-05-09T08:02:05.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdef75ee640 1 --2- 172.21.15.87:0/1031178717 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 0x7fdef00b51b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdef75ee640 1 -- 172.21.15.87:0/1031178717 >> 172.21.15.87:0/1031178717 conn(0x7fdef00677b0 msgr2=0x7fdef00bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:05.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdef75ee640 1 -- 172.21.15.87:0/1031178717 shutdown_connections 2024-05-09T08:02:05.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.289+0000 7fdef75ee640 1 -- 172.21.15.87:0/1031178717 wait complete. 2024-05-09T08:02:05.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.290+0000 7fdef75ee640 1 Processor -- start 2024-05-09T08:02:05.308 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.290+0000 7fdef75ee640 1 -- start start 2024-05-09T08:02:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef75ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 0x7fdef01385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef75ee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef00b56f0 0x7fdef013a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef75ee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdef0141ec0 0x7fdef01dd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef75ee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdef0148580 con 0x7fdef00b4dd0 2024-05-09T08:02:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef75ee640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdef0148400 con 0x7fdef00b56f0 2024-05-09T08:02:05.310 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef75ee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fdef0139a40 con 0x7fdef0141ec0 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef538a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 0x7fdef01385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef538a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 0x7fdef01385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44352/0 (socket says 172.21.15.87:44352) 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef538a640 1 -- 172.21.15.87:0/259784272 learned_addr learned my addr 172.21.15.87:0/259784272 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef4b89640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef00b56f0 0x7fdef013a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef5b8b640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdef0141ec0 0x7fdef01dd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef538a640 1 -- 172.21.15.87:0/259784272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdef0141ec0 msgr2=0x7fdef01dd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef538a640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdef0141ec0 0x7fdef01dd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef538a640 1 -- 172.21.15.87:0/259784272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef00b56f0 msgr2=0x7fdef013a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef538a640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef00b56f0 0x7fdef013a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef538a640 1 -- 172.21.15.87:0/259784272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef013a6d0 con 0x7fdef00b4dd0 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.291+0000 7fdef4b89640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef00b56f0 0x7fdef013a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.292+0000 7fdef538a640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 0x7fdef01385a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdee00098c0 tx=0x7fdee00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.292+0000 7fdeedffb640 1 -- 172.21.15.87:0/259784272 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0037040 con 0x7fdef00b4dd0 2024-05-09T08:02:05.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.292+0000 7fdeedffb640 1 -- 172.21.15.87:0/259784272 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee0030770 con 0x7fdef00b4dd0 2024-05-09T08:02:05.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.292+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef0139710 con 0x7fdef00b4dd0 2024-05-09T08:02:05.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.292+0000 7fdeedffb640 1 -- 172.21.15.87:0/259784272 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0030b40 con 0x7fdef00b4dd0 2024-05-09T08:02:05.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.292+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef0143f30 con 0x7fdef00b4dd0 2024-05-09T08:02:05.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.293+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef00691f0 con 0x7fdef00b4dd0 2024-05-09T08:02:05.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.293+0000 7fdeedffb640 1 -- 172.21.15.87:0/259784272 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdee0044020 con 0x7fdef00b4dd0 2024-05-09T08:02:05.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.294+0000 7fdeedffb640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdedc06be60 0x7fdedc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.294+0000 7fdeedffb640 1 -- 172.21.15.87:0/259784272 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fdee00ab410 con 0x7fdef00b4dd0 2024-05-09T08:02:05.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.294+0000 7fdef4b89640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdedc06be60 0x7fdedc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.294+0000 7fdef4b89640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdedc06be60 0x7fdedc06e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdef0138e30 tx=0x7fdee4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:05.315 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.298+0000 7fdeedffb640 1 -- 172.21.15.87:0/259784272 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdef013a6d0 con 0x7fdef00b4dd0 2024-05-09T08:02:05.491 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.474+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdef00bbb00 con 0x7fdef00b4dd0 2024-05-09T08:02:05.492 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.474+0000 7fdeedffb640 1 -- 172.21.15.87:0/259784272 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fdee0032e20 con 0x7fdef00b4dd0 2024-05-09T08:02:05.492 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 64 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdedc06be60 msgr2=0x7fdedc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdedc06be60 0x7fdedc06e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdef0138e30 tx=0x7fdee4009040 comp rx=0 tx=0).stop 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 msgr2=0x7fdef01385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 0x7fdef01385a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdee00098c0 tx=0x7fdee00046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 shutdown_connections 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdedc06be60 0x7fdedc06e320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdef0141ec0 0x7fdef01dd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef00b56f0 0x7fdef013a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 --2- 172.21.15.87:0/259784272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdef00b4dd0 0x7fdef01385a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.494 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 >> 172.21.15.87:0/259784272 conn(0x7fdef00677b0 msgr2=0x7fdef00b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 shutdown_connections 2024-05-09T08:02:05.495 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.476+0000 7fdef75ee640 1 -- 172.21.15.87:0/259784272 wait complete. 2024-05-09T08:02:05.506 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T08:02:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.589+0000 7f9845ba2640 1 Processor -- start 2024-05-09T08:02:05.607 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.589+0000 7f9845ba2640 1 -- start start 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f9845ba2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98400b39d0 0x7f98400add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f9845ba2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9840148350 0x7f984014f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f9845ba2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98400b15a0 con 0x7f98400ae2c0 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f9845ba2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f98400ae720 con 0x7f9840148350 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f9845ba2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f98400b3db0 con 0x7f98400b39d0 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f983ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9840148350 0x7f984014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f983ffff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9840148350 0x7f984014f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44368/0 (socket says 172.21.15.87:44368) 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f983ffff640 1 -- 172.21.15.87:0/1329947410 learned_addr learned my addr 172.21.15.87:0/1329947410 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f983ffff640 1 -- 172.21.15.87:0/1329947410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98400b39d0 msgr2=0x7f98400add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f983ffff640 1 --2- 172.21.15.87:0/1329947410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98400b39d0 0x7f98400add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f983ffff640 1 -- 172.21.15.87:0/1329947410 >> v1:172.21.15.110:6789/0 conn(0x7f98400ae2c0 legacy=0x7f9840147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.590+0000 7f983ffff640 1 -- 172.21.15.87:0/1329947410 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98400af940 con 0x7f9840148350 2024-05-09T08:02:05.609 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.591+0000 7f983ffff640 1 --2- 172.21.15.87:0/1329947410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 0x7f984014f180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f983800bb10 tx=0x7f983802c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344a7612b7f2936e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:05.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.591+0000 7f983e7fc640 1 -- 172.21.15.87:0/1329947410 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983803a070 con 0x7f9840148350 2024-05-09T08:02:05.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.591+0000 7f983e7fc640 1 -- 172.21.15.87:0/1329947410 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380326f0 con 0x7f9840148350 2024-05-09T08:02:05.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.591+0000 7f983e7fc640 1 -- 172.21.15.87:0/1329947410 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838032ac0 con 0x7f9840148350 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.592+0000 7f9845ba2640 1 -- 172.21.15.87:0/1329947410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 msgr2=0x7f984014f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.592+0000 7f9845ba2640 1 --2- 172.21.15.87:0/1329947410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 0x7f984014f180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f983800bb10 tx=0x7f983802c830 comp rx=0 tx=0).stop 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.592+0000 7f9845ba2640 1 -- 172.21.15.87:0/1329947410 shutdown_connections 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.592+0000 7f9845ba2640 1 --2- 172.21.15.87:0/1329947410 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 0x7f984014f180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.592+0000 7f9845ba2640 1 --2- 172.21.15.87:0/1329947410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98400b39d0 0x7f98400add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.592+0000 7f9845ba2640 1 -- 172.21.15.87:0/1329947410 >> 172.21.15.87:0/1329947410 conn(0x7f98400b5860 msgr2=0x7f98400b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.592+0000 7f9845ba2640 1 -- 172.21.15.87:0/1329947410 shutdown_connections 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.592+0000 7f9845ba2640 1 -- 172.21.15.87:0/1329947410 wait complete. 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.593+0000 7f9845ba2640 1 Processor -- start 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.593+0000 7f9845ba2640 1 -- start start 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9845ba2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98400ae2c0 0x7f98401cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9845ba2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98400b39d0 0x7f98401d94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.613 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9845ba2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 0x7f98401d9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9845ba2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f984006d9b0 con 0x7f9840148350 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9845ba2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f984006d830 con 0x7f98400ae2c0 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9845ba2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f98401487e0 con 0x7f98400b39d0 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 0x7f98401d9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 0x7f98401d9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:44384/0 (socket says 172.21.15.87:44384) 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983ffff640 1 -- 172.21.15.87:0/1555399466 learned_addr learned my addr 172.21.15.87:0/1555399466 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983f7fe640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98400ae2c0 0x7f98401cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983effd640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98400b39d0 0x7f98401d94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983ffff640 1 -- 172.21.15.87:0/1555399466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98400b39d0 msgr2=0x7f98401d94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983ffff640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98400b39d0 0x7f98401d94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983ffff640 1 -- 172.21.15.87:0/1555399466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98400ae2c0 msgr2=0x7f98401cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983ffff640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98400ae2c0 0x7f98401cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983ffff640 1 -- 172.21.15.87:0/1555399466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98400709c0 con 0x7f9840148350 2024-05-09T08:02:05.614 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f983ffff640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 0x7f98401d9a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f983802c870 tx=0x7f98380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9827fff640 1 -- 172.21.15.87:0/1555399466 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838045070 con 0x7f9840148350 2024-05-09T08:02:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9827fff640 1 -- 172.21.15.87:0/1555399466 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9838035680 con 0x7f9840148350 2024-05-09T08:02:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984006f620 con 0x7f9840148350 2024-05-09T08:02:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9827fff640 1 -- 172.21.15.87:0/1555399466 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983803a040 con 0x7f9840148350 2024-05-09T08:02:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.594+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98400706e0 con 0x7f9840148350 2024-05-09T08:02:05.615 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.595+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98400691f0 con 0x7f9840148350 2024-05-09T08:02:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.596+0000 7f9827fff640 1 -- 172.21.15.87:0/1555399466 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9838048070 con 0x7f9840148350 2024-05-09T08:02:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.596+0000 7f9827fff640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f982c06be30 0x7f982c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.596+0000 7f983f7fe640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f982c06be30 0x7f982c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.596+0000 7f9827fff640 1 -- 172.21.15.87:0/1555399466 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f98380adcc0 con 0x7f9840148350 2024-05-09T08:02:05.616 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.597+0000 7f983f7fe640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f982c06be30 0x7f982c06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9830009990 tx=0x7f9830009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:05.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.601+0000 7f9827fff640 1 -- 172.21.15.87:0/1555399466 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f983807c670 con 0x7f9840148350 2024-05-09T08:02:05.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.789+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f98400b7a70 con 0x7f9840148350 2024-05-09T08:02:05.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.789+0000 7f9827fff640 1 -- 172.21.15.87:0/1555399466 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f983807bf70 con 0x7f9840148350 2024-05-09T08:02:05.807 INFO:teuthology.orchestra.run.smithi087.stderr:listed 0 entries 2024-05-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.791+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f982c06be30 msgr2=0x7f982c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.791+0000 7f9845ba2640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f982c06be30 0x7f982c06e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9830009990 tx=0x7f9830009110 comp rx=0 tx=0).stop 2024-05-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.791+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 msgr2=0x7f98401d9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.791+0000 7f9845ba2640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 0x7f98401d9a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f983802c870 tx=0x7f98380046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.792+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 shutdown_connections 2024-05-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.792+0000 7f9845ba2640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f982c06be30 0x7f982c06e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.792+0000 7f9845ba2640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98400b39d0 0x7f98401d94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.792+0000 7f9845ba2640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9840148350 0x7f98401d9a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.810 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.792+0000 7f9845ba2640 1 --2- 172.21.15.87:0/1555399466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98400ae2c0 0x7f98401cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:05.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.792+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 >> 172.21.15.87:0/1555399466 conn(0x7f98400b5860 msgr2=0x7f98400b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:05.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.792+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 shutdown_connections 2024-05-09T08:02:05.811 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:05.792+0000 7f9845ba2640 1 -- 172.21.15.87:0/1555399466 wait complete. 2024-05-09T08:02:05.821 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi087.front.sepia.ceph.com... 2024-05-09T08:02:05.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T08:02:05.821 DEBUG:teuthology.orchestra.run.smithi087:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-09T08:02:06.154 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[44567]: fuse finished with error 0 and tester_r 0 2024-05-09T08:02:06.156 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:12.257 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T08:02:12.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T08:02:12.258 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T08:02:12.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T08:02:12.556 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-05-09T08:02:12.582 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T08:02:12.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T08:02:12.582 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T08:02:12.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T08:02:12.653 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-05-09T08:02:12.761 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-09T08:02:12.771 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T08:02:12.771 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T08:02:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.860+0000 7fde2b309640 1 Processor -- start 2024-05-09T08:02:12.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.860+0000 7fde2b309640 1 -- start start 2024-05-09T08:02:12.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.861+0000 7fde2b309640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fde24147bd0 0x7fde24148040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:12.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.861+0000 7fde2b309640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde240b6240 con 0x7fde240b5330 2024-05-09T08:02:12.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.861+0000 7fde2b309640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde240b1860 con 0x7fde240b5e60 2024-05-09T08:02:12.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.861+0000 7fde2b309640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fde240b0470 con 0x7fde24147bd0 2024-05-09T08:02:12.880 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.861+0000 7fde288a4640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fde240b5330 0x7fde240b2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59502/0 (socket says 172.21.15.87:59502) 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.861+0000 7fde288a4640 1 -- 172.21.15.87:0/2562112740 learned_addr learned my addr 172.21.15.87:0/2562112740 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.861+0000 7fde298a6640 1 --2- 172.21.15.87:0/2562112740 >> v2:172.21.15.110:3300/0 conn(0x7fde24147bd0 0x7fde24148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.861+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502605613 0 0) 0x7fde240b6240 con 0x7fde240b5330 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde10003520 con 0x7fde240b5330 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1993449877 0 0) 0x7fde10003520 con 0x7fde240b5330 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 >> v2:172.21.15.110:3300/0 conn(0x7fde24147bd0 msgr2=0x7fde24148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 --2- 172.21.15.87:0/2562112740 >> v2:172.21.15.110:3300/0 conn(0x7fde24147bd0 0x7fde24148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 >> v1:172.21.15.110:6789/0 conn(0x7fde240b5e60 legacy=0x7fde240b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde240afd40 con 0x7fde240b5330 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7fde18001670 con 0x7fde240b5330 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 >> v1:172.21.15.87:6789/0 conn(0x7fde240b5330 legacy=0x7fde240b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde100039b0 0x7fde10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde10004800 0x7fde10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde100051c0 0x7fde1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fde1000c130 con 0x7fde10004800 2024-05-09T08:02:12.881 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fde1000c2e0 con 0x7fde100039b0 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fde1000c4e0 con 0x7fde100051c0 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde288a4640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde10004800 0x7fde10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde290a5640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde100039b0 0x7fde10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde298a6640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde100051c0 0x7fde1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde288a4640 1 -- 172.21.15.87:0/2562112740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde100051c0 msgr2=0x7fde1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde288a4640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde100051c0 0x7fde1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde288a4640 1 -- 172.21.15.87:0/2562112740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde100039b0 msgr2=0x7fde10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde288a4640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde100039b0 0x7fde10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde288a4640 1 -- 172.21.15.87:0/2562112740 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde10003520 con 0x7fde10004800 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.862+0000 7fde298a6640 1 -- 172.21.15.87:0/2562112740 reap_dead start 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.863+0000 7fde288a4640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde10004800 0x7fde10004c80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c240 tx=0x7fde10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e42ae9bded95a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.863+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18007cf0 con 0x7fde10004800 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.863+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde18005ad0 con 0x7fde10004800 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.863+0000 7fde17fff640 1 -- 172.21.15.87:0/2562112740 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18007070 con 0x7fde10004800 2024-05-09T08:02:12.882 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.864+0000 7fde2b309640 1 -- 172.21.15.87:0/2562112740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde10004800 msgr2=0x7fde10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.864+0000 7fde2b309640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde10004800 0x7fde10004c80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c240 tx=0x7fde10005830 comp rx=0 tx=0).stop 2024-05-09T08:02:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.864+0000 7fde2b309640 1 -- 172.21.15.87:0/2562112740 shutdown_connections 2024-05-09T08:02:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.864+0000 7fde2b309640 1 --2- 172.21.15.87:0/2562112740 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde10004800 0x7fde10004c80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.864+0000 7fde2b309640 1 -- 172.21.15.87:0/2562112740 >> 172.21.15.87:0/2562112740 conn(0x7fde2406c6a0 msgr2=0x7fde2406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.864+0000 7fde2b309640 1 -- 172.21.15.87:0/2562112740 shutdown_connections 2024-05-09T08:02:12.883 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.864+0000 7fde2b309640 1 -- 172.21.15.87:0/2562112740 wait complete. 2024-05-09T08:02:12.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde2b309640 1 Processor -- start 2024-05-09T08:02:12.886 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde2b309640 1 -- start start 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde2b309640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10004800 0x7fde240b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde2b309640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2409d5c0 0x7fde2409da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde2b309640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde2409aa40 0x7fde2409aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde2b309640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fde24148040 con 0x7fde2409d5c0 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde2b309640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fde240b1580 con 0x7fde10004800 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde2b309640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fde241481c0 con 0x7fde2409aa40 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde288a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2409d5c0 0x7fde2409da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde288a4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2409d5c0 0x7fde2409da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47006/0 (socket says 172.21.15.87:47006) 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.865+0000 7fde288a4640 1 -- 172.21.15.87:0/938052711 learned_addr learned my addr 172.21.15.87:0/938052711 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde290a5640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10004800 0x7fde240b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde288a4640 1 -- 172.21.15.87:0/938052711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde2409aa40 msgr2=0x7fde2409aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde288a4640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde2409aa40 0x7fde2409aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde288a4640 1 -- 172.21.15.87:0/938052711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10004800 msgr2=0x7fde240b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde288a4640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10004800 0x7fde240b8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde288a4640 1 -- 172.21.15.87:0/938052711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2409df80 con 0x7fde2409d5c0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde288a4640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2409d5c0 0x7fde2409da40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c360 tx=0x7fde240b03e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde15ffb640 1 -- 172.21.15.87:0/938052711 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18037040 con 0x7fde2409d5c0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde15ffb640 1 -- 172.21.15.87:0/938052711 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde18001470 con 0x7fde2409d5c0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2409d0e0 con 0x7fde2409d5c0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde15ffb640 1 -- 172.21.15.87:0/938052711 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde180047e0 con 0x7fde2409d5c0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.866+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2409cb20 con 0x7fde2409d5c0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.867+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde240691f0 con 0x7fde2409d5c0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.868+0000 7fde15ffb640 1 -- 172.21.15.87:0/938052711 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde18043030 con 0x7fde2409d5c0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.868+0000 7fde15ffb640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fde0806be30 0x7fde0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.868+0000 7fde15ffb640 1 -- 172.21.15.87:0/938052711 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fde180aa390 con 0x7fde2409d5c0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.868+0000 7fde290a5640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fde0806be30 0x7fde0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:12.888 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.869+0000 7fde290a5640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fde0806be30 0x7fde0806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde20000c00 tx=0x7fde20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:12.889 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:12.873+0000 7fde15ffb640 1 -- 172.21.15.87:0/938052711 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fde1804a020 con 0x7fde2409d5c0 2024-05-09T08:02:13.061 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.044+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde24070b20 con 0x7fde0806be30 2024-05-09T08:02:13.067 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.050+0000 7fde15ffb640 1 -- 172.21.15.87:0/938052711 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253589 (secure 0 0 0) 0x7fde24070b20 con 0x7fde0806be30 2024-05-09T08:02:13.069 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:13.071 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T08:02:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fde0806be30 msgr2=0x7fde0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fde0806be30 0x7fde0806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde20000c00 tx=0x7fde20009040 comp rx=0 tx=0).stop 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2409d5c0 msgr2=0x7fde2409da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2409d5c0 0x7fde2409da40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c360 tx=0x7fde240b03e0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 shutdown_connections 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fde0806be30 0x7fde0806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde2409aa40 0x7fde2409aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fde2409d5c0 0x7fde2409da40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 --2- 172.21.15.87:0/938052711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10004800 0x7fde240b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 >> 172.21.15.87:0/938052711 conn(0x7fde2406c6a0 msgr2=0x7fde24071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 shutdown_connections 2024-05-09T08:02:13.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.053+0000 7fde2b309640 1 -- 172.21.15.87:0/938052711 wait complete. 2024-05-09T08:02:13.081 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-05-09T08:02:12.984978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":150898066,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1422,"num_read_kb":2045,"num_write":66424,"num_write_kb":764086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54871,"ondisk_log_size":54871,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":804040,"kb_used_data":296648,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":754170680,"statfs":{"total":773094113280,"available":772270776320,"internally_reserved":0,"allocated":303767552,"data_stored":302494644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":519491121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":217371,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003085"},"pg_stats":[{"pgid":"3.3f","version":"23'599","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192547+0000","last_change":"2024-05-09T07:54:37.107065+0000","last_active":"2024-05-09T08:02:06.192547+0000","last_peered":"2024-05-09T08:02:06.192547+0000","last_clean":"2024-05-09T08:02:06.192547+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T08:02:06.192547+0000","last_undegraded":"2024-05-09T08:02:06.192547+0000","last_fullsized":"2024-05-09T08:02:06.192547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'629","reported_seq":648,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197366+0000","last_change":"2024-05-09T07:54:37.109460+0000","last_active":"2024-05-09T08:02:06.197366+0000","last_peered":"2024-05-09T08:02:06.197366+0000","last_clean":"2024-05-09T08:02:06.197366+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T08:02:06.197366+0000","last_undegraded":"2024-05-09T08:02:06.197366+0000","last_fullsized":"2024-05-09T08:02:06.197366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":3580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'592","reported_seq":611,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198154+0000","last_change":"2024-05-09T07:54:37.108923+0000","last_active":"2024-05-09T08:02:06.198154+0000","last_peered":"2024-05-09T08:02:06.198154+0000","last_clean":"2024-05-09T08:02:06.198154+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T08:02:06.198154+0000","last_undegraded":"2024-05-09T08:02:06.198154+0000","last_fullsized":"2024-05-09T08:02:06.198154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'587","reported_seq":606,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202093+0000","last_change":"2024-05-09T07:54:37.104600+0000","last_active":"2024-05-09T08:02:06.202093+0000","last_peered":"2024-05-09T08:02:06.202093+0000","last_clean":"2024-05-09T08:02:06.202093+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T08:02:06.202093+0000","last_undegraded":"2024-05-09T08:02:06.202093+0000","last_fullsized":"2024-05-09T08:02:06.202093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":3262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'613","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182772+0000","last_change":"2024-05-09T07:54:37.104101+0000","last_active":"2024-05-09T08:02:06.182772+0000","last_peered":"2024-05-09T08:02:06.182772+0000","last_clean":"2024-05-09T08:02:06.182772+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T08:02:06.182772+0000","last_undegraded":"2024-05-09T08:02:06.182772+0000","last_fullsized":"2024-05-09T08:02:06.182772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'586","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199162+0000","last_change":"2024-05-09T07:54:37.109462+0000","last_active":"2024-05-09T08:02:06.199162+0000","last_peered":"2024-05-09T08:02:06.199162+0000","last_clean":"2024-05-09T08:02:06.199162+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T08:02:06.199162+0000","last_undegraded":"2024-05-09T08:02:06.199162+0000","last_fullsized":"2024-05-09T08:02:06.199162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":3420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'619","reported_seq":638,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182552+0000","last_change":"2024-05-09T07:54:37.114222+0000","last_active":"2024-05-09T08:02:06.182552+0000","last_peered":"2024-05-09T08:02:06.182552+0000","last_clean":"2024-05-09T08:02:06.182552+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T08:02:06.182552+0000","last_undegraded":"2024-05-09T08:02:06.182552+0000","last_fullsized":"2024-05-09T08:02:06.182552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'582","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202534+0000","last_change":"2024-05-09T07:54:37.110852+0000","last_active":"2024-05-09T08:02:06.202534+0000","last_peered":"2024-05-09T08:02:06.202534+0000","last_clean":"2024-05-09T08:02:06.202534+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T08:02:06.202534+0000","last_undegraded":"2024-05-09T08:02:06.202534+0000","last_fullsized":"2024-05-09T08:02:06.202534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":3532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'626","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197188+0000","last_change":"2024-05-09T07:54:37.106997+0000","last_active":"2024-05-09T08:02:06.197188+0000","last_peered":"2024-05-09T08:02:06.197188+0000","last_clean":"2024-05-09T08:02:06.197188+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T08:02:06.197188+0000","last_undegraded":"2024-05-09T08:02:06.197188+0000","last_fullsized":"2024-05-09T08:02:06.197188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":762,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'591","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.181461+0000","last_change":"2024-05-09T07:54:37.112111+0000","last_active":"2024-05-09T08:02:06.181461+0000","last_peered":"2024-05-09T08:02:06.181461+0000","last_clean":"2024-05-09T08:02:06.181461+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T08:02:06.181461+0000","last_undegraded":"2024-05-09T08:02:06.181461+0000","last_fullsized":"2024-05-09T08:02:06.181461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":3173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'551","reported_seq":570,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179585+0000","last_change":"2024-05-09T07:54:37.111412+0000","last_active":"2024-05-09T08:02:06.179585+0000","last_peered":"2024-05-09T08:02:06.179585+0000","last_clean":"2024-05-09T08:02:06.179585+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T08:02:06.179585+0000","last_undegraded":"2024-05-09T08:02:06.179585+0000","last_fullsized":"2024-05-09T08:02:06.179585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'545","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179793+0000","last_change":"2024-05-09T07:54:37.103229+0000","last_active":"2024-05-09T08:02:06.179793+0000","last_peered":"2024-05-09T08:02:06.179793+0000","last_clean":"2024-05-09T08:02:06.179793+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T08:02:06.179793+0000","last_undegraded":"2024-05-09T08:02:06.179793+0000","last_fullsized":"2024-05-09T08:02:06.179793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'584","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202129+0000","last_change":"2024-05-09T07:54:37.104238+0000","last_active":"2024-05-09T08:02:06.202129+0000","last_peered":"2024-05-09T08:02:06.202129+0000","last_clean":"2024-05-09T08:02:06.202129+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T08:02:06.202129+0000","last_undegraded":"2024-05-09T08:02:06.202129+0000","last_fullsized":"2024-05-09T08:02:06.202129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":3698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'626","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.203263+0000","last_change":"2024-05-09T07:54:37.105958+0000","last_active":"2024-05-09T08:02:06.203263+0000","last_peered":"2024-05-09T08:02:06.203263+0000","last_clean":"2024-05-09T08:02:06.203263+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T08:02:06.203263+0000","last_undegraded":"2024-05-09T08:02:06.203263+0000","last_fullsized":"2024-05-09T08:02:06.203263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:38.316625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":3967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'617","reported_seq":636,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196088+0000","last_change":"2024-05-09T07:54:37.090690+0000","last_active":"2024-05-09T08:02:06.196088+0000","last_peered":"2024-05-09T08:02:06.196088+0000","last_clean":"2024-05-09T08:02:06.196088+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T08:02:06.196088+0000","last_undegraded":"2024-05-09T08:02:06.196088+0000","last_fullsized":"2024-05-09T08:02:06.196088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":3825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'651","reported_seq":670,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197138+0000","last_change":"2024-05-09T07:54:37.110834+0000","last_active":"2024-05-09T08:02:06.197138+0000","last_peered":"2024-05-09T08:02:06.197138+0000","last_clean":"2024-05-09T08:02:06.197138+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T08:02:06.197138+0000","last_undegraded":"2024-05-09T08:02:06.197138+0000","last_fullsized":"2024-05-09T08:02:06.197138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'630","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185714+0000","last_change":"2024-05-09T07:54:37.099545+0000","last_active":"2024-05-09T08:02:06.185714+0000","last_peered":"2024-05-09T08:02:06.185714+0000","last_clean":"2024-05-09T08:02:06.185714+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T08:02:06.185714+0000","last_undegraded":"2024-05-09T08:02:06.185714+0000","last_fullsized":"2024-05-09T08:02:06.185714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":3592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'592","reported_seq":611,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184552+0000","last_change":"2024-05-09T07:54:37.105054+0000","last_active":"2024-05-09T08:02:06.184552+0000","last_peered":"2024-05-09T08:02:06.184552+0000","last_clean":"2024-05-09T08:02:06.184552+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T08:02:06.184552+0000","last_undegraded":"2024-05-09T08:02:06.184552+0000","last_fullsized":"2024-05-09T08:02:06.184552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'619","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196667+0000","last_change":"2024-05-09T07:55:18.561520+0000","last_active":"2024-05-09T08:02:06.196667+0000","last_peered":"2024-05-09T08:02:06.196667+0000","last_clean":"2024-05-09T08:02:06.196667+0000","last_became_active":"2024-05-09T07:55:18.561115+0000","last_became_peered":"2024-05-09T07:55:18.561115+0000","last_unstale":"2024-05-09T08:02:06.196667+0000","last_undegraded":"2024-05-09T08:02:06.196667+0000","last_fullsized":"2024-05-09T08:02:06.196667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:48.961063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"23'657","reported_seq":676,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.178687+0000","last_change":"2024-05-09T07:54:37.110846+0000","last_active":"2024-05-09T08:02:06.178687+0000","last_peered":"2024-05-09T08:02:06.178687+0000","last_clean":"2024-05-09T08:02:06.178687+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T08:02:06.178687+0000","last_undegraded":"2024-05-09T08:02:06.178687+0000","last_fullsized":"2024-05-09T08:02:06.178687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'610","reported_seq":629,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.205481+0000","last_change":"2024-05-09T07:54:37.110392+0000","last_active":"2024-05-09T08:02:06.205481+0000","last_peered":"2024-05-09T08:02:06.205481+0000","last_clean":"2024-05-09T08:02:06.205481+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T08:02:06.205481+0000","last_undegraded":"2024-05-09T08:02:06.205481+0000","last_fullsized":"2024-05-09T08:02:06.205481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":3681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'647","reported_seq":666,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185643+0000","last_change":"2024-05-09T07:54:37.098797+0000","last_active":"2024-05-09T08:02:06.185643+0000","last_peered":"2024-05-09T08:02:06.185643+0000","last_clean":"2024-05-09T08:02:06.185643+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T08:02:06.185643+0000","last_undegraded":"2024-05-09T08:02:06.185643+0000","last_fullsized":"2024-05-09T08:02:06.185643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":798,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'606","reported_seq":625,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200517+0000","last_change":"2024-05-09T07:54:37.112262+0000","last_active":"2024-05-09T08:02:06.200517+0000","last_peered":"2024-05-09T08:02:06.200517+0000","last_clean":"2024-05-09T08:02:06.200517+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T08:02:06.200517+0000","last_undegraded":"2024-05-09T08:02:06.200517+0000","last_fullsized":"2024-05-09T08:02:06.200517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":3749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'666","reported_seq":685,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202404+0000","last_change":"2024-05-09T07:54:37.102723+0000","last_active":"2024-05-09T08:02:06.202404+0000","last_peered":"2024-05-09T08:02:06.202404+0000","last_clean":"2024-05-09T08:02:06.202404+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T08:02:06.202404+0000","last_undegraded":"2024-05-09T08:02:06.202404+0000","last_fullsized":"2024-05-09T08:02:06.202404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":3958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'636","reported_seq":655,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199477+0000","last_change":"2024-05-09T07:54:37.101021+0000","last_active":"2024-05-09T08:02:06.199477+0000","last_peered":"2024-05-09T08:02:06.199477+0000","last_clean":"2024-05-09T08:02:06.199477+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T08:02:06.199477+0000","last_undegraded":"2024-05-09T08:02:06.199477+0000","last_fullsized":"2024-05-09T08:02:06.199477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'718","reported_seq":737,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195868+0000","last_change":"2024-05-09T07:54:37.106515+0000","last_active":"2024-05-09T08:02:06.195868+0000","last_peered":"2024-05-09T08:02:06.195868+0000","last_clean":"2024-05-09T08:02:06.195868+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T08:02:06.195868+0000","last_undegraded":"2024-05-09T08:02:06.195868+0000","last_fullsized":"2024-05-09T08:02:06.195868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'618","reported_seq":637,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202609+0000","last_change":"2024-05-09T07:54:37.101475+0000","last_active":"2024-05-09T08:02:06.202609+0000","last_peered":"2024-05-09T08:02:06.202609+0000","last_clean":"2024-05-09T08:02:06.202609+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T08:02:06.202609+0000","last_undegraded":"2024-05-09T08:02:06.202609+0000","last_fullsized":"2024-05-09T08:02:06.202609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'588","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200874+0000","last_change":"2024-05-09T07:54:37.112908+0000","last_active":"2024-05-09T08:02:06.200874+0000","last_peered":"2024-05-09T08:02:06.200874+0000","last_clean":"2024-05-09T08:02:06.200874+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T08:02:06.200874+0000","last_undegraded":"2024-05-09T08:02:06.200874+0000","last_fullsized":"2024-05-09T08:02:06.200874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":3451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'618","reported_seq":637,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.204290+0000","last_change":"2024-05-09T07:54:37.109141+0000","last_active":"2024-05-09T08:02:06.204290+0000","last_peered":"2024-05-09T08:02:06.204290+0000","last_clean":"2024-05-09T08:02:06.204290+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T08:02:06.204290+0000","last_undegraded":"2024-05-09T08:02:06.204290+0000","last_fullsized":"2024-05-09T08:02:06.204290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'697","reported_seq":716,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194343+0000","last_change":"2024-05-09T07:54:37.103105+0000","last_active":"2024-05-09T08:02:06.194343+0000","last_peered":"2024-05-09T08:02:06.194343+0000","last_clean":"2024-05-09T08:02:06.194343+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T08:02:06.194343+0000","last_undegraded":"2024-05-09T08:02:06.194343+0000","last_fullsized":"2024-05-09T08:02:06.194343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":843,"num_write_kb":3831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'687","reported_seq":706,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.173818+0000","last_change":"2024-05-09T07:54:37.109657+0000","last_active":"2024-05-09T08:02:06.173818+0000","last_peered":"2024-05-09T08:02:06.173818+0000","last_clean":"2024-05-09T08:02:06.173818+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T08:02:06.173818+0000","last_undegraded":"2024-05-09T08:02:06.173818+0000","last_fullsized":"2024-05-09T08:02:06.173818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'658","reported_seq":677,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198966+0000","last_change":"2024-05-09T07:54:37.111278+0000","last_active":"2024-05-09T08:02:06.198966+0000","last_peered":"2024-05-09T08:02:06.198966+0000","last_clean":"2024-05-09T08:02:06.198966+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T08:02:06.198966+0000","last_undegraded":"2024-05-09T08:02:06.198966+0000","last_fullsized":"2024-05-09T08:02:06.198966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'616","reported_seq":635,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.193871+0000","last_change":"2024-05-09T07:54:37.099560+0000","last_active":"2024-05-09T08:02:06.193871+0000","last_peered":"2024-05-09T08:02:06.193871+0000","last_clean":"2024-05-09T08:02:06.193871+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T08:02:06.193871+0000","last_undegraded":"2024-05-09T08:02:06.193871+0000","last_fullsized":"2024-05-09T08:02:06.193871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:30.636185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":3676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'432","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.221372+0000","last_change":"2024-05-09T07:54:36.105511+0000","last_active":"2024-05-09T08:01:57.221372+0000","last_peered":"2024-05-09T08:01:57.221372+0000","last_clean":"2024-05-09T08:01:57.221372+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T08:01:57.221372+0000","last_undegraded":"2024-05-09T08:01:57.221372+0000","last_fullsized":"2024-05-09T08:01:57.221372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":480,"num_write_kb":8805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'556","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.206383+0000","last_change":"2024-05-09T07:54:37.110626+0000","last_active":"2024-05-09T08:02:06.206383+0000","last_peered":"2024-05-09T08:02:06.206383+0000","last_clean":"2024-05-09T08:02:06.206383+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T08:02:06.206383+0000","last_undegraded":"2024-05-09T08:02:06.206383+0000","last_fullsized":"2024-05-09T08:02:06.206383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":668,"num_write_kb":3012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'950","reported_seq":971,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.242506+0000","last_change":"2024-05-09T07:54:36.099522+0000","last_active":"2024-05-09T08:01:57.242506+0000","last_peered":"2024-05-09T08:01:57.242506+0000","last_clean":"2024-05-09T08:01:57.242506+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T08:01:57.242506+0000","last_undegraded":"2024-05-09T08:01:57.242506+0000","last_fullsized":"2024-05-09T08:01:57.242506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1015,"num_write_kb":29485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'176","reported_seq":197,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.954166+0000","last_change":"2024-05-09T07:54:36.103352+0000","last_active":"2024-05-09T08:01:53.954166+0000","last_peered":"2024-05-09T08:01:53.954166+0000","last_clean":"2024-05-09T08:01:53.954166+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T08:01:53.954166+0000","last_undegraded":"2024-05-09T08:01:53.954166+0000","last_fullsized":"2024-05-09T08:01:53.954166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":217,"num_write_kb":8642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'671","reported_seq":690,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198240+0000","last_change":"2024-05-09T07:54:37.113565+0000","last_active":"2024-05-09T08:02:06.198240+0000","last_peered":"2024-05-09T08:02:06.198240+0000","last_clean":"2024-05-09T08:02:06.198240+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T08:02:06.198240+0000","last_undegraded":"2024-05-09T08:02:06.198240+0000","last_fullsized":"2024-05-09T08:02:06.198240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'710","reported_seq":731,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.210384+0000","last_change":"2024-05-09T07:54:36.091893+0000","last_active":"2024-05-09T08:01:54.210384+0000","last_peered":"2024-05-09T08:01:54.210384+0000","last_clean":"2024-05-09T08:01:54.210384+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T08:01:54.210384+0000","last_undegraded":"2024-05-09T08:01:54.210384+0000","last_fullsized":"2024-05-09T08:01:54.210384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":749,"num_write_kb":37565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'621","reported_seq":640,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202751+0000","last_change":"2024-05-09T07:54:37.106284+0000","last_active":"2024-05-09T08:02:06.202751+0000","last_peered":"2024-05-09T08:02:06.202751+0000","last_clean":"2024-05-09T08:02:06.202751+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T08:02:06.202751+0000","last_undegraded":"2024-05-09T08:02:06.202751+0000","last_fullsized":"2024-05-09T08:02:06.202751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":3585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'140","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.141597+0000","last_change":"2024-05-09T07:54:36.100068+0000","last_active":"2024-05-09T08:02:06.141597+0000","last_peered":"2024-05-09T08:02:06.141597+0000","last_clean":"2024-05-09T08:02:06.141597+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T08:02:06.141597+0000","last_undegraded":"2024-05-09T08:02:06.141597+0000","last_fullsized":"2024-05-09T08:02:06.141597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10381600,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":185,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'661","reported_seq":673,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.191831+0000","last_change":"2024-05-09T07:55:18.903031+0000","last_active":"2024-05-09T08:02:06.191831+0000","last_peered":"2024-05-09T08:02:06.191831+0000","last_clean":"2024-05-09T08:02:06.191831+0000","last_became_active":"2024-05-09T07:55:18.902706+0000","last_became_peered":"2024-05-09T07:55:18.902706+0000","last_unstale":"2024-05-09T08:02:06.191831+0000","last_undegraded":"2024-05-09T08:02:06.191831+0000","last_fullsized":"2024-05-09T08:02:06.191831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'443","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.201493+0000","last_change":"2024-05-09T07:54:36.100368+0000","last_active":"2024-05-09T08:01:56.201493+0000","last_peered":"2024-05-09T08:01:56.201493+0000","last_clean":"2024-05-09T08:01:56.201493+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T08:01:56.201493+0000","last_undegraded":"2024-05-09T08:01:56.201493+0000","last_fullsized":"2024-05-09T08:01:56.201493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":490,"num_write_kb":25148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'591","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199607+0000","last_change":"2024-05-09T07:54:37.107847+0000","last_active":"2024-05-09T08:02:06.199607+0000","last_peered":"2024-05-09T08:02:06.199607+0000","last_clean":"2024-05-09T08:02:06.199607+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T08:02:06.199607+0000","last_undegraded":"2024-05-09T08:02:06.199607+0000","last_fullsized":"2024-05-09T08:02:06.199607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'768","reported_seq":789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.276875+0000","last_change":"2024-05-09T07:54:36.101694+0000","last_active":"2024-05-09T08:01:57.276875+0000","last_peered":"2024-05-09T08:01:57.276875+0000","last_clean":"2024-05-09T08:01:57.276875+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T08:01:57.276875+0000","last_undegraded":"2024-05-09T08:01:57.276875+0000","last_fullsized":"2024-05-09T08:01:57.276875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":817,"num_write_kb":21310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'594","reported_seq":613,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195234+0000","last_change":"2024-05-09T07:54:37.098733+0000","last_active":"2024-05-09T08:02:06.195234+0000","last_peered":"2024-05-09T08:02:06.195234+0000","last_clean":"2024-05-09T08:02:06.195234+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T08:02:06.195234+0000","last_undegraded":"2024-05-09T08:02:06.195234+0000","last_fullsized":"2024-05-09T08:02:06.195234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:15.571989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'821","reported_seq":842,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.249921+0000","last_change":"2024-05-09T07:54:36.103096+0000","last_active":"2024-05-09T08:01:54.249921+0000","last_peered":"2024-05-09T08:01:54.249921+0000","last_clean":"2024-05-09T08:01:54.249921+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T08:01:54.249921+0000","last_undegraded":"2024-05-09T08:01:54.249921+0000","last_fullsized":"2024-05-09T08:01:54.249921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":851,"num_write_kb":25125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'612","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185887+0000","last_change":"2024-05-09T07:54:37.101875+0000","last_active":"2024-05-09T08:02:06.185887+0000","last_peered":"2024-05-09T08:02:06.185887+0000","last_clean":"2024-05-09T08:02:06.185887+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T08:02:06.185887+0000","last_undegraded":"2024-05-09T08:02:06.185887+0000","last_fullsized":"2024-05-09T08:02:06.185887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'702","reported_seq":723,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:49.153612+0000","last_change":"2024-05-09T07:54:36.090977+0000","last_active":"2024-05-09T08:01:49.153612+0000","last_peered":"2024-05-09T08:01:49.153612+0000","last_clean":"2024-05-09T08:01:49.153612+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T08:01:49.153612+0000","last_undegraded":"2024-05-09T08:01:49.153612+0000","last_fullsized":"2024-05-09T08:01:49.153612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:17.768144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":750,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'628","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200287+0000","last_change":"2024-05-09T07:54:37.105813+0000","last_active":"2024-05-09T08:02:06.200287+0000","last_peered":"2024-05-09T08:02:06.200287+0000","last_clean":"2024-05-09T08:02:06.200287+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T08:02:06.200287+0000","last_undegraded":"2024-05-09T08:02:06.200287+0000","last_fullsized":"2024-05-09T08:02:06.200287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:02.185354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'74","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.208101+0000","last_change":"2024-05-09T07:54:36.102510+0000","last_active":"2024-05-09T08:01:56.208101+0000","last_peered":"2024-05-09T08:01:56.208101+0000","last_clean":"2024-05-09T08:01:56.208101+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T08:01:56.208101+0000","last_undegraded":"2024-05-09T08:01:56.208101+0000","last_fullsized":"2024-05-09T08:01:56.208101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":148,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195420+0000","last_change":"2024-05-09T07:54:37.105015+0000","last_active":"2024-05-09T08:02:06.195420+0000","last_peered":"2024-05-09T08:02:06.195420+0000","last_clean":"2024-05-09T08:02:06.195420+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T08:02:06.195420+0000","last_undegraded":"2024-05-09T08:02:06.195420+0000","last_fullsized":"2024-05-09T08:02:06.195420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":3484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'101","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.227008+0000","last_change":"2024-05-09T07:54:36.103721+0000","last_active":"2024-05-09T08:01:57.227008+0000","last_peered":"2024-05-09T08:01:57.227008+0000","last_clean":"2024-05-09T08:01:57.227008+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T08:01:57.227008+0000","last_undegraded":"2024-05-09T08:01:57.227008+0000","last_fullsized":"2024-05-09T08:01:57.227008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":161,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'724","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.191153+0000","last_change":"2024-05-09T07:54:37.111215+0000","last_active":"2024-05-09T08:02:06.191153+0000","last_peered":"2024-05-09T08:02:06.191153+0000","last_clean":"2024-05-09T08:02:06.191153+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T08:02:06.191153+0000","last_undegraded":"2024-05-09T08:02:06.191153+0000","last_fullsized":"2024-05-09T08:02:06.191153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":3636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'183","reported_seq":204,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:52.188023+0000","last_change":"2024-05-09T07:54:36.098598+0000","last_active":"2024-05-09T08:01:52.188023+0000","last_peered":"2024-05-09T08:01:52.188023+0000","last_clean":"2024-05-09T08:01:52.188023+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T08:01:52.188023+0000","last_undegraded":"2024-05-09T08:01:52.188023+0000","last_fullsized":"2024-05-09T08:01:52.188023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":241,"num_write_kb":8581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'724","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.190619+0000","last_change":"2024-05-09T07:54:37.102764+0000","last_active":"2024-05-09T08:02:06.190619+0000","last_peered":"2024-05-09T08:02:06.190619+0000","last_clean":"2024-05-09T08:02:06.190619+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T08:02:06.190619+0000","last_undegraded":"2024-05-09T08:02:06.190619+0000","last_fullsized":"2024-05-09T08:02:06.190619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":3956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'289","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.201064+0000","last_change":"2024-05-09T07:54:36.092365+0000","last_active":"2024-05-09T08:01:56.201064+0000","last_peered":"2024-05-09T08:01:56.201064+0000","last_clean":"2024-05-09T08:01:56.201064+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T08:01:56.201064+0000","last_undegraded":"2024-05-09T08:01:56.201064+0000","last_fullsized":"2024-05-09T08:01:56.201064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":360,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'586","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192923+0000","last_change":"2024-05-09T07:54:37.100214+0000","last_active":"2024-05-09T08:02:06.192923+0000","last_peered":"2024-05-09T08:02:06.192923+0000","last_clean":"2024-05-09T08:02:06.192923+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T08:02:06.192923+0000","last_undegraded":"2024-05-09T08:02:06.192923+0000","last_fullsized":"2024-05-09T08:02:06.192923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":3597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'316","reported_seq":337,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.200234+0000","last_change":"2024-05-09T07:54:36.100004+0000","last_active":"2024-05-09T08:01:56.200234+0000","last_peered":"2024-05-09T08:01:56.200234+0000","last_clean":"2024-05-09T08:01:56.200234+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T08:01:56.200234+0000","last_undegraded":"2024-05-09T08:01:56.200234+0000","last_fullsized":"2024-05-09T08:01:56.200234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":351,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'580","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197234+0000","last_change":"2024-05-09T07:54:37.100879+0000","last_active":"2024-05-09T08:02:06.197234+0000","last_peered":"2024-05-09T08:02:06.197234+0000","last_clean":"2024-05-09T08:02:06.197234+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T08:02:06.197234+0000","last_undegraded":"2024-05-09T08:02:06.197234+0000","last_fullsized":"2024-05-09T08:02:06.197234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'462","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.295843+0000","last_change":"2024-05-09T07:54:36.099594+0000","last_active":"2024-05-09T08:01:55.295843+0000","last_peered":"2024-05-09T08:01:55.295843+0000","last_clean":"2024-05-09T08:01:55.295843+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T08:01:55.295843+0000","last_undegraded":"2024-05-09T08:01:55.295843+0000","last_fullsized":"2024-05-09T08:01:55.295843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":512,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'682","reported_seq":695,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182300+0000","last_change":"2024-05-09T07:55:18.559305+0000","last_active":"2024-05-09T08:02:06.182300+0000","last_peered":"2024-05-09T08:02:06.182300+0000","last_clean":"2024-05-09T08:02:06.182300+0000","last_became_active":"2024-05-09T07:55:18.558939+0000","last_became_peered":"2024-05-09T07:55:18.558939+0000","last_unstale":"2024-05-09T08:02:06.182300+0000","last_undegraded":"2024-05-09T08:02:06.182300+0000","last_fullsized":"2024-05-09T08:02:06.182300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"23'248","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.420616+0000","last_change":"2024-05-09T07:54:36.097398+0000","last_active":"2024-05-09T08:01:54.420616+0000","last_peered":"2024-05-09T08:01:54.420616+0000","last_clean":"2024-05-09T08:01:54.420616+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T08:01:54.420616+0000","last_undegraded":"2024-05-09T08:01:54.420616+0000","last_fullsized":"2024-05-09T08:01:54.420616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":299,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'588","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.187188+0000","last_change":"2024-05-09T07:54:37.108574+0000","last_active":"2024-05-09T08:02:06.187188+0000","last_peered":"2024-05-09T08:02:06.187188+0000","last_clean":"2024-05-09T08:02:06.187188+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T08:02:06.187188+0000","last_undegraded":"2024-05-09T08:02:06.187188+0000","last_fullsized":"2024-05-09T08:02:06.187188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":3417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T07:58:28.929423+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:58:28.929423+0000","last_peered":"2024-05-09T07:58:28.929423+0000","last_clean":"2024-05-09T07:58:28.929423+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:58:28.929423+0000","last_undegraded":"2024-05-09T07:58:28.929423+0000","last_fullsized":"2024-05-09T07:58:28.929423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'199","reported_seq":220,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.423265+0000","last_change":"2024-05-09T07:54:36.097635+0000","last_active":"2024-05-09T08:01:54.423265+0000","last_peered":"2024-05-09T08:01:54.423265+0000","last_clean":"2024-05-09T08:01:54.423265+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T08:01:54.423265+0000","last_undegraded":"2024-05-09T08:01:54.423265+0000","last_fullsized":"2024-05-09T08:01:54.423265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":237,"num_write_kb":12549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'566","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192763+0000","last_change":"2024-05-09T07:54:37.111470+0000","last_active":"2024-05-09T08:02:06.192763+0000","last_peered":"2024-05-09T08:02:06.192763+0000","last_clean":"2024-05-09T08:02:06.192763+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T08:02:06.192763+0000","last_undegraded":"2024-05-09T08:02:06.192763+0000","last_fullsized":"2024-05-09T08:02:06.192763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":3530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'754","reported_seq":775,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.206375+0000","last_change":"2024-05-09T07:54:36.107162+0000","last_active":"2024-05-09T08:01:56.206375+0000","last_peered":"2024-05-09T08:01:56.206375+0000","last_clean":"2024-05-09T08:01:56.206375+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T08:01:56.206375+0000","last_undegraded":"2024-05-09T08:01:56.206375+0000","last_fullsized":"2024-05-09T08:01:56.206375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":793,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184193+0000","last_change":"2024-05-09T07:54:37.102062+0000","last_active":"2024-05-09T08:02:06.184193+0000","last_peered":"2024-05-09T08:02:06.184193+0000","last_clean":"2024-05-09T08:02:06.184193+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T08:02:06.184193+0000","last_undegraded":"2024-05-09T08:02:06.184193+0000","last_fullsized":"2024-05-09T08:02:06.184193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:32.555846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":3702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'938","reported_seq":1645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:58.206696+0000","last_change":"2024-05-09T07:54:36.100227+0000","last_active":"2024-05-09T08:01:58.206696+0000","last_peered":"2024-05-09T08:01:58.206696+0000","last_clean":"2024-05-09T08:01:58.206696+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T08:01:58.206696+0000","last_undegraded":"2024-05-09T08:01:58.206696+0000","last_fullsized":"2024-05-09T08:01:58.206696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512596,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":706,"num_read_kb":1945,"num_write":995,"num_write_kb":14766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194027+0000","last_change":"2024-05-09T07:54:37.109167+0000","last_active":"2024-05-09T08:02:06.194027+0000","last_peered":"2024-05-09T08:02:06.194027+0000","last_clean":"2024-05-09T08:02:06.194027+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T08:02:06.194027+0000","last_undegraded":"2024-05-09T08:02:06.194027+0000","last_fullsized":"2024-05-09T08:02:06.194027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":3437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'650","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.250789+0000","last_change":"2024-05-09T07:54:36.100426+0000","last_active":"2024-05-09T08:01:54.250789+0000","last_peered":"2024-05-09T08:01:54.250789+0000","last_clean":"2024-05-09T08:01:54.250789+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T08:01:54.250789+0000","last_undegraded":"2024-05-09T08:01:54.250789+0000","last_fullsized":"2024-05-09T08:01:54.250789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":708,"num_write_kb":29261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'605","reported_seq":624,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194904+0000","last_change":"2024-05-09T07:54:37.108794+0000","last_active":"2024-05-09T08:02:06.194904+0000","last_peered":"2024-05-09T08:02:06.194904+0000","last_clean":"2024-05-09T08:02:06.194904+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T08:02:06.194904+0000","last_undegraded":"2024-05-09T08:02:06.194904+0000","last_fullsized":"2024-05-09T08:02:06.194904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:43.498827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'182","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.203877+0000","last_change":"2024-05-09T07:54:36.104155+0000","last_active":"2024-05-09T08:01:56.203877+0000","last_peered":"2024-05-09T08:01:56.203877+0000","last_clean":"2024-05-09T08:01:56.203877+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T08:01:56.203877+0000","last_undegraded":"2024-05-09T08:01:56.203877+0000","last_fullsized":"2024-05-09T08:01:56.203877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":263,"num_write_kb":8685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'644","reported_seq":663,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194002+0000","last_change":"2024-05-09T07:54:37.103562+0000","last_active":"2024-05-09T08:02:06.194002+0000","last_peered":"2024-05-09T08:02:06.194002+0000","last_clean":"2024-05-09T08:02:06.194002+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T08:02:06.194002+0000","last_undegraded":"2024-05-09T08:02:06.194002+0000","last_fullsized":"2024-05-09T08:02:06.194002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'488","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.207750+0000","last_change":"2024-05-09T07:54:36.106399+0000","last_active":"2024-05-09T08:01:56.207750+0000","last_peered":"2024-05-09T08:01:56.207750+0000","last_clean":"2024-05-09T08:01:56.207750+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T08:01:56.207750+0000","last_undegraded":"2024-05-09T08:01:56.207750+0000","last_fullsized":"2024-05-09T08:01:56.207750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":548,"num_write_kb":21106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'589","reported_seq":608,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196818+0000","last_change":"2024-05-09T07:54:37.105988+0000","last_active":"2024-05-09T08:02:06.196818+0000","last_peered":"2024-05-09T08:02:06.196818+0000","last_clean":"2024-05-09T08:02:06.196818+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T08:02:06.196818+0000","last_undegraded":"2024-05-09T08:02:06.196818+0000","last_fullsized":"2024-05-09T08:02:06.196818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":3737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'475","reported_seq":496,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:00.873819+0000","last_change":"2024-05-09T07:54:36.101002+0000","last_active":"2024-05-09T08:02:00.873819+0000","last_peered":"2024-05-09T08:02:00.873819+0000","last_clean":"2024-05-09T08:02:00.873819+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T08:02:00.873819+0000","last_undegraded":"2024-05-09T08:02:00.873819+0000","last_fullsized":"2024-05-09T08:02:00.873819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1199,"num_write_kb":9658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'541","reported_seq":560,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184733+0000","last_change":"2024-05-09T07:54:37.100183+0000","last_active":"2024-05-09T08:02:06.184733+0000","last_peered":"2024-05-09T08:02:06.184733+0000","last_clean":"2024-05-09T08:02:06.184733+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T08:02:06.184733+0000","last_undegraded":"2024-05-09T08:02:06.184733+0000","last_fullsized":"2024-05-09T08:02:06.184733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'250","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.209315+0000","last_change":"2024-05-09T07:54:36.105813+0000","last_active":"2024-05-09T08:01:56.209315+0000","last_peered":"2024-05-09T08:01:56.209315+0000","last_clean":"2024-05-09T08:01:56.209315+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T08:01:56.209315+0000","last_undegraded":"2024-05-09T08:01:56.209315+0000","last_fullsized":"2024-05-09T08:01:56.209315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":329,"num_write_kb":8747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'732","reported_seq":751,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.201728+0000","last_change":"2024-05-09T07:54:37.107782+0000","last_active":"2024-05-09T08:02:06.201728+0000","last_peered":"2024-05-09T08:02:06.201728+0000","last_clean":"2024-05-09T08:02:06.201728+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T08:02:06.201728+0000","last_undegraded":"2024-05-09T08:02:06.201728+0000","last_fullsized":"2024-05-09T08:02:06.201728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'189","reported_seq":210,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.297656+0000","last_change":"2024-05-09T07:54:36.106409+0000","last_active":"2024-05-09T08:01:55.297656+0000","last_peered":"2024-05-09T08:01:55.297656+0000","last_clean":"2024-05-09T08:01:55.297656+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T08:01:55.297656+0000","last_undegraded":"2024-05-09T08:01:55.297656+0000","last_fullsized":"2024-05-09T08:01:55.297656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":230,"num_write_kb":8511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'679","reported_seq":698,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179837+0000","last_change":"2024-05-09T07:54:37.104920+0000","last_active":"2024-05-09T08:02:06.179837+0000","last_peered":"2024-05-09T08:02:06.179837+0000","last_clean":"2024-05-09T08:02:06.179837+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T08:02:06.179837+0000","last_undegraded":"2024-05-09T08:02:06.179837+0000","last_fullsized":"2024-05-09T08:02:06.179837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":3995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'230","reported_seq":251,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:52.209441+0000","last_change":"2024-05-09T07:54:36.105662+0000","last_active":"2024-05-09T08:01:52.209441+0000","last_peered":"2024-05-09T08:01:52.209441+0000","last_clean":"2024-05-09T08:01:52.209441+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T08:01:52.209441+0000","last_undegraded":"2024-05-09T08:01:52.209441+0000","last_fullsized":"2024-05-09T08:01:52.209441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":261,"num_write_kb":12547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'635","reported_seq":654,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200088+0000","last_change":"2024-05-09T07:54:37.103640+0000","last_active":"2024-05-09T08:02:06.200088+0000","last_peered":"2024-05-09T08:02:06.200088+0000","last_clean":"2024-05-09T08:02:06.200088+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T08:02:06.200088+0000","last_undegraded":"2024-05-09T08:02:06.200088+0000","last_fullsized":"2024-05-09T08:02:06.200088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'493","reported_seq":514,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.222839+0000","last_change":"2024-05-09T07:54:36.102636+0000","last_active":"2024-05-09T08:01:57.222839+0000","last_peered":"2024-05-09T08:01:57.222839+0000","last_clean":"2024-05-09T08:01:57.222839+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T08:01:57.222839+0000","last_undegraded":"2024-05-09T08:01:57.222839+0000","last_fullsized":"2024-05-09T08:01:57.222839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":567,"num_write_kb":25391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'646","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.201248+0000","last_change":"2024-05-09T07:55:18.902612+0000","last_active":"2024-05-09T08:02:06.201248+0000","last_peered":"2024-05-09T08:02:06.201248+0000","last_clean":"2024-05-09T08:02:06.201248+0000","last_became_active":"2024-05-09T07:55:18.902275+0000","last_became_peered":"2024-05-09T07:55:18.902275+0000","last_unstale":"2024-05-09T08:02:06.201248+0000","last_undegraded":"2024-05-09T08:02:06.201248+0000","last_fullsized":"2024-05-09T08:02:06.201248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:54.608551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":3818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"23'887","reported_seq":908,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:50.185785+0000","last_change":"2024-05-09T07:54:36.104367+0000","last_active":"2024-05-09T08:01:50.185785+0000","last_peered":"2024-05-09T08:01:50.185785+0000","last_clean":"2024-05-09T08:01:50.185785+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T08:01:50.185785+0000","last_undegraded":"2024-05-09T08:01:50.185785+0000","last_fullsized":"2024-05-09T08:01:50.185785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":934,"num_write_kb":29264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'642","reported_seq":661,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.180045+0000","last_change":"2024-05-09T07:54:37.111038+0000","last_active":"2024-05-09T08:02:06.180045+0000","last_peered":"2024-05-09T08:02:06.180045+0000","last_clean":"2024-05-09T08:02:06.180045+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T08:02:06.180045+0000","last_undegraded":"2024-05-09T08:02:06.180045+0000","last_fullsized":"2024-05-09T08:02:06.180045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":3781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'597","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.178625+0000","last_change":"2024-05-09T07:55:18.558479+0000","last_active":"2024-05-09T08:02:06.178625+0000","last_peered":"2024-05-09T08:02:06.178625+0000","last_clean":"2024-05-09T08:02:06.178625+0000","last_became_active":"2024-05-09T07:55:18.558037+0000","last_became_peered":"2024-05-09T07:55:18.558037+0000","last_unstale":"2024-05-09T08:02:06.178625+0000","last_undegraded":"2024-05-09T08:02:06.178625+0000","last_fullsized":"2024-05-09T08:02:06.178625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'190","reported_seq":211,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.240539+0000","last_change":"2024-05-09T07:54:36.105726+0000","last_active":"2024-05-09T08:01:57.240539+0000","last_peered":"2024-05-09T08:01:57.240539+0000","last_clean":"2024-05-09T08:01:57.240539+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T08:01:57.240539+0000","last_undegraded":"2024-05-09T08:01:57.240539+0000","last_fullsized":"2024-05-09T08:01:57.240539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":262,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'590","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.172605+0000","last_change":"2024-05-09T07:54:37.092061+0000","last_active":"2024-05-09T08:02:06.172605+0000","last_peered":"2024-05-09T08:02:06.172605+0000","last_clean":"2024-05-09T08:02:06.172605+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T08:02:06.172605+0000","last_undegraded":"2024-05-09T08:02:06.172605+0000","last_fullsized":"2024-05-09T08:02:06.172605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1115","reported_seq":1136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.157658+0000","last_change":"2024-05-09T07:54:36.106635+0000","last_active":"2024-05-09T08:01:53.157658+0000","last_peered":"2024-05-09T08:01:53.157658+0000","last_clean":"2024-05-09T08:01:53.157658+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T08:01:53.157658+0000","last_undegraded":"2024-05-09T08:01:53.157658+0000","last_fullsized":"2024-05-09T08:01:53.157658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1161,"num_write_kb":29324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'532","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199819+0000","last_change":"2024-05-09T07:54:37.108470+0000","last_active":"2024-05-09T08:02:06.199819+0000","last_peered":"2024-05-09T08:02:06.199819+0000","last_clean":"2024-05-09T08:02:06.199819+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T08:02:06.199819+0000","last_undegraded":"2024-05-09T08:02:06.199819+0000","last_fullsized":"2024-05-09T08:02:06.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":3333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'708","reported_seq":729,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.297864+0000","last_change":"2024-05-09T07:54:36.102502+0000","last_active":"2024-05-09T08:01:55.297864+0000","last_peered":"2024-05-09T08:01:55.297864+0000","last_clean":"2024-05-09T08:01:55.297864+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T08:01:55.297864+0000","last_undegraded":"2024-05-09T08:01:55.297864+0000","last_fullsized":"2024-05-09T08:01:55.297864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":745,"num_write_kb":29116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'614","reported_seq":633,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194093+0000","last_change":"2024-05-09T07:54:37.104598+0000","last_active":"2024-05-09T08:02:06.194093+0000","last_peered":"2024-05-09T08:02:06.194093+0000","last_clean":"2024-05-09T08:02:06.194093+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T08:02:06.194093+0000","last_undegraded":"2024-05-09T08:02:06.194093+0000","last_fullsized":"2024-05-09T08:02:06.194093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'491","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.157976+0000","last_change":"2024-05-09T07:54:36.101744+0000","last_active":"2024-05-09T08:01:53.157976+0000","last_peered":"2024-05-09T08:01:53.157976+0000","last_clean":"2024-05-09T08:01:53.157976+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T08:01:53.157976+0000","last_undegraded":"2024-05-09T08:01:53.157976+0000","last_fullsized":"2024-05-09T08:01:53.157976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":559,"num_write_kb":8798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48848,"num_write_kb":235793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39700,"ondisk_log_size":39700,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":150307698,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1306,"num_read_kb":1945,"num_write":17417,"num_write_kb":525877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":300679168,"data_stored":300615396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15054,"ondisk_log_size":15054,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542241,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102712,"kb_used_data":53488,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94269128,"statfs":{"total":96636764160,"available":96531587072,"internally_reserved":0,"allocated":54771712,"data_stored":54613426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542241,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":21304,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":21815296,"data_stored":21649840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100920,"kb_used_data":29488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270920,"statfs":{"total":96636764160,"available":96533422080,"internally_reserved":0,"allocated":30195712,"data_stored":30038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122772,"kb_used_data":47244,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94249068,"statfs":{"total":96636764160,"available":96511045632,"internally_reserved":0,"allocated":48377856,"data_stored":48218322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108752,"kb_used_data":59528,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94263088,"statfs":{"total":96636764160,"available":96525402112,"internally_reserved":0,"allocated":60956672,"data_stored":60800652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116668,"kb_used_data":45300,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94255172,"statfs":{"total":96636764160,"available":96517296128,"internally_reserved":0,"allocated":46387200,"data_stored":46224784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101824,"kb_used_data":26296,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94270016,"statfs":{"total":96636764160,"available":96532496384,"internally_reserved":0,"allocated":26927104,"data_stored":26766406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71544,"kb_used_data":14000,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300296,"statfs":{"total":96636764160,"available":96563503104,"internally_reserved":0,"allocated":14336000,"data_stored":14182822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":54534144,"data_stored":54526112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14098432,"data_stored":14095508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26689536,"data_stored":26679092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":60719104,"data_stored":60713338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48140288,"data_stored":48131008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T08:02:13.085 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T08:02:13.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.206+0000 7eff226b3640 1 Processor -- start 2024-05-09T08:02:13.223 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.206+0000 7eff226b3640 1 -- start start 2024-05-09T08:02:13.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff226b3640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff1c072cb0 0x7eff1c13f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff226b3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c13f990 0x7eff1c14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff226b3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1c0b6240 con 0x7eff1c0b5e60 2024-05-09T08:02:13.224 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff226b3640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7eff1c0b2cb0 con 0x7eff1c072cb0 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff226b3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c0b31c0 con 0x7eff1c13f990 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff1b7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff1c072cb0 0x7eff1c13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff1b7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7eff1c072cb0 0x7eff1c13f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47010/0 (socket says 172.21.15.87:47010) 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff1b7fe640 1 -- 172.21.15.87:0/1650262915 learned_addr learned my addr 172.21.15.87:0/1650262915 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff20c50640 1 --2- 172.21.15.87:0/1650262915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c13f990 0x7eff1c14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff1b7fe640 1 -- 172.21.15.87:0/1650262915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c13f990 msgr2=0x7eff1c14ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff1b7fe640 1 --2- 172.21.15.87:0/1650262915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c13f990 0x7eff1c14ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff1b7fe640 1 -- 172.21.15.87:0/1650262915 >> v1:172.21.15.110:6789/0 conn(0x7eff1c0b5e60 legacy=0x7eff1c149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.207+0000 7eff1b7fe640 1 -- 172.21.15.87:0/1650262915 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c13fe20 con 0x7eff1c072cb0 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff1b7fe640 1 --2- 172.21.15.87:0/1650262915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 0x7eff1c13f450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff10009870 tx=0x7eff1002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee3690e6c8083ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff1affd640 1 -- 172.21.15.87:0/1650262915 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10037070 con 0x7eff1c072cb0 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff1affd640 1 -- 172.21.15.87:0/1650262915 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff10032440 con 0x7eff1c072cb0 2024-05-09T08:02:13.225 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff1affd640 1 -- 172.21.15.87:0/1650262915 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10032810 con 0x7eff1c072cb0 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff226b3640 1 -- 172.21.15.87:0/1650262915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 msgr2=0x7eff1c13f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff226b3640 1 --2- 172.21.15.87:0/1650262915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 0x7eff1c13f450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff10009870 tx=0x7eff1002a1c0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff226b3640 1 -- 172.21.15.87:0/1650262915 shutdown_connections 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff226b3640 1 --2- 172.21.15.87:0/1650262915 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c13f990 0x7eff1c14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff226b3640 1 --2- 172.21.15.87:0/1650262915 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 0x7eff1c13f450 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff226b3640 1 -- 172.21.15.87:0/1650262915 >> 172.21.15.87:0/1650262915 conn(0x7eff1c06c6a0 msgr2=0x7eff1c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff226b3640 1 -- 172.21.15.87:0/1650262915 shutdown_connections 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.208+0000 7eff226b3640 1 -- 172.21.15.87:0/1650262915 wait complete. 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.209+0000 7eff226b3640 1 Processor -- start 2024-05-09T08:02:13.228 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff226b3640 1 -- start start 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff226b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 0x7eff1c1e0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff226b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0b5e60 0x7eff1c144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff226b3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c13f990 0x7eff1c144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff226b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0b2ee0 con 0x7eff1c072cb0 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff226b3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c148df0 con 0x7eff1c0b5e60 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff226b3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c09ee00 con 0x7eff1c13f990 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 0x7eff1c1e0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 0x7eff1c1e0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47012/0 (socket says 172.21.15.87:47012) 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.210+0000 7eff1bfff640 1 -- 172.21.15.87:0/2279463267 learned_addr learned my addr 172.21.15.87:0/2279463267 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff1b7fe640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0b5e60 0x7eff1c144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff1bfff640 1 -- 172.21.15.87:0/2279463267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c13f990 msgr2=0x7eff1c144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff1bfff640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c13f990 0x7eff1c144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff1bfff640 1 -- 172.21.15.87:0/2279463267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0b5e60 msgr2=0x7eff1c144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff1bfff640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0b5e60 0x7eff1c144900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff1bfff640 1 -- 172.21.15.87:0/2279463267 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c1466e0 con 0x7eff1c072cb0 2024-05-09T08:02:13.229 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff1bfff640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 0x7eff1c1e0c10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c440 tx=0x7eff0c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:13.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff18ff9640 1 -- 172.21.15.87:0/2279463267 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0052d0 con 0x7eff1c072cb0 2024-05-09T08:02:13.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff18ff9640 1 -- 172.21.15.87:0/2279463267 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c005470 con 0x7eff1c072cb0 2024-05-09T08:02:13.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c0afc20 con 0x7eff1c072cb0 2024-05-09T08:02:13.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff18ff9640 1 -- 172.21.15.87:0/2279463267 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c012870 con 0x7eff1c072cb0 2024-05-09T08:02:13.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.211+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c143530 con 0x7eff1c072cb0 2024-05-09T08:02:13.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.212+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c0691f0 con 0x7eff1c072cb0 2024-05-09T08:02:13.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.212+0000 7eff18ff9640 1 -- 172.21.15.87:0/2279463267 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff0c012a10 con 0x7eff1c072cb0 2024-05-09T08:02:13.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.213+0000 7eff18ff9640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7eff0806be30 0x7eff0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.213+0000 7eff18ff9640 1 -- 172.21.15.87:0/2279463267 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7eff0c08aab0 con 0x7eff1c072cb0 2024-05-09T08:02:13.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.213+0000 7eff1b7fe640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7eff0806be30 0x7eff0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.213+0000 7eff1b7fe640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7eff0806be30 0x7eff0806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff10034000 tx=0x7eff1002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:13.233 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.217+0000 7eff18ff9640 1 -- 172.21.15.87:0/2279463267 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7eff0c059460 con 0x7eff1c072cb0 2024-05-09T08:02:13.403 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.387+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff1c0b6bd0 con 0x7eff0806be30 2024-05-09T08:02:13.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.392+0000 7eff18ff9640 1 -- 172.21.15.87:0/2279463267 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253589 (secure 0 0 0) 0x7eff1c0b6bd0 con 0x7eff0806be30 2024-05-09T08:02:13.413 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:13.414 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7eff0806be30 msgr2=0x7eff0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.415 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7eff0806be30 0x7eff0806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff10034000 tx=0x7eff1002e000 comp rx=0 tx=0).stop 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 msgr2=0x7eff1c1e0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 0x7eff1c1e0c10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00c440 tx=0x7eff0c00c900 comp rx=0 tx=0).stop 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 shutdown_connections 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7eff0806be30 0x7eff0806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c13f990 0x7eff1c144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0b5e60 0x7eff1c144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 --2- 172.21.15.87:0/2279463267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7eff1c072cb0 0x7eff1c1e0c10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.395+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 >> 172.21.15.87:0/2279463267 conn(0x7eff1c06c6a0 msgr2=0x7eff1c13b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.396+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 shutdown_connections 2024-05-09T08:02:13.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.396+0000 7eff226b3640 1 -- 172.21.15.87:0/2279463267 wait complete. 2024-05-09T08:02:13.423 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-05-09T08:02:12.984978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":150898066,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1422,"num_read_kb":2045,"num_write":66424,"num_write_kb":764086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54871,"ondisk_log_size":54871,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":804040,"kb_used_data":296648,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":754170680,"statfs":{"total":773094113280,"available":772270776320,"internally_reserved":0,"allocated":303767552,"data_stored":302494644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":519491121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":217371,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003085"},"pg_stats":[{"pgid":"3.3f","version":"23'599","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192547+0000","last_change":"2024-05-09T07:54:37.107065+0000","last_active":"2024-05-09T08:02:06.192547+0000","last_peered":"2024-05-09T08:02:06.192547+0000","last_clean":"2024-05-09T08:02:06.192547+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T08:02:06.192547+0000","last_undegraded":"2024-05-09T08:02:06.192547+0000","last_fullsized":"2024-05-09T08:02:06.192547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'629","reported_seq":648,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197366+0000","last_change":"2024-05-09T07:54:37.109460+0000","last_active":"2024-05-09T08:02:06.197366+0000","last_peered":"2024-05-09T08:02:06.197366+0000","last_clean":"2024-05-09T08:02:06.197366+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T08:02:06.197366+0000","last_undegraded":"2024-05-09T08:02:06.197366+0000","last_fullsized":"2024-05-09T08:02:06.197366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":3580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'592","reported_seq":611,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198154+0000","last_change":"2024-05-09T07:54:37.108923+0000","last_active":"2024-05-09T08:02:06.198154+0000","last_peered":"2024-05-09T08:02:06.198154+0000","last_clean":"2024-05-09T08:02:06.198154+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T08:02:06.198154+0000","last_undegraded":"2024-05-09T08:02:06.198154+0000","last_fullsized":"2024-05-09T08:02:06.198154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'587","reported_seq":606,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202093+0000","last_change":"2024-05-09T07:54:37.104600+0000","last_active":"2024-05-09T08:02:06.202093+0000","last_peered":"2024-05-09T08:02:06.202093+0000","last_clean":"2024-05-09T08:02:06.202093+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T08:02:06.202093+0000","last_undegraded":"2024-05-09T08:02:06.202093+0000","last_fullsized":"2024-05-09T08:02:06.202093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":3262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'613","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182772+0000","last_change":"2024-05-09T07:54:37.104101+0000","last_active":"2024-05-09T08:02:06.182772+0000","last_peered":"2024-05-09T08:02:06.182772+0000","last_clean":"2024-05-09T08:02:06.182772+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T08:02:06.182772+0000","last_undegraded":"2024-05-09T08:02:06.182772+0000","last_fullsized":"2024-05-09T08:02:06.182772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'586","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199162+0000","last_change":"2024-05-09T07:54:37.109462+0000","last_active":"2024-05-09T08:02:06.199162+0000","last_peered":"2024-05-09T08:02:06.199162+0000","last_clean":"2024-05-09T08:02:06.199162+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T08:02:06.199162+0000","last_undegraded":"2024-05-09T08:02:06.199162+0000","last_fullsized":"2024-05-09T08:02:06.199162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":3420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'619","reported_seq":638,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182552+0000","last_change":"2024-05-09T07:54:37.114222+0000","last_active":"2024-05-09T08:02:06.182552+0000","last_peered":"2024-05-09T08:02:06.182552+0000","last_clean":"2024-05-09T08:02:06.182552+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T08:02:06.182552+0000","last_undegraded":"2024-05-09T08:02:06.182552+0000","last_fullsized":"2024-05-09T08:02:06.182552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'582","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202534+0000","last_change":"2024-05-09T07:54:37.110852+0000","last_active":"2024-05-09T08:02:06.202534+0000","last_peered":"2024-05-09T08:02:06.202534+0000","last_clean":"2024-05-09T08:02:06.202534+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T08:02:06.202534+0000","last_undegraded":"2024-05-09T08:02:06.202534+0000","last_fullsized":"2024-05-09T08:02:06.202534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":3532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'626","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197188+0000","last_change":"2024-05-09T07:54:37.106997+0000","last_active":"2024-05-09T08:02:06.197188+0000","last_peered":"2024-05-09T08:02:06.197188+0000","last_clean":"2024-05-09T08:02:06.197188+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T08:02:06.197188+0000","last_undegraded":"2024-05-09T08:02:06.197188+0000","last_fullsized":"2024-05-09T08:02:06.197188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":762,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'591","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.181461+0000","last_change":"2024-05-09T07:54:37.112111+0000","last_active":"2024-05-09T08:02:06.181461+0000","last_peered":"2024-05-09T08:02:06.181461+0000","last_clean":"2024-05-09T08:02:06.181461+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T08:02:06.181461+0000","last_undegraded":"2024-05-09T08:02:06.181461+0000","last_fullsized":"2024-05-09T08:02:06.181461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":3173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'551","reported_seq":570,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179585+0000","last_change":"2024-05-09T07:54:37.111412+0000","last_active":"2024-05-09T08:02:06.179585+0000","last_peered":"2024-05-09T08:02:06.179585+0000","last_clean":"2024-05-09T08:02:06.179585+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T08:02:06.179585+0000","last_undegraded":"2024-05-09T08:02:06.179585+0000","last_fullsized":"2024-05-09T08:02:06.179585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'545","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179793+0000","last_change":"2024-05-09T07:54:37.103229+0000","last_active":"2024-05-09T08:02:06.179793+0000","last_peered":"2024-05-09T08:02:06.179793+0000","last_clean":"2024-05-09T08:02:06.179793+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T08:02:06.179793+0000","last_undegraded":"2024-05-09T08:02:06.179793+0000","last_fullsized":"2024-05-09T08:02:06.179793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'584","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202129+0000","last_change":"2024-05-09T07:54:37.104238+0000","last_active":"2024-05-09T08:02:06.202129+0000","last_peered":"2024-05-09T08:02:06.202129+0000","last_clean":"2024-05-09T08:02:06.202129+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T08:02:06.202129+0000","last_undegraded":"2024-05-09T08:02:06.202129+0000","last_fullsized":"2024-05-09T08:02:06.202129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":3698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'626","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.203263+0000","last_change":"2024-05-09T07:54:37.105958+0000","last_active":"2024-05-09T08:02:06.203263+0000","last_peered":"2024-05-09T08:02:06.203263+0000","last_clean":"2024-05-09T08:02:06.203263+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T08:02:06.203263+0000","last_undegraded":"2024-05-09T08:02:06.203263+0000","last_fullsized":"2024-05-09T08:02:06.203263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:38.316625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":3967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'617","reported_seq":636,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196088+0000","last_change":"2024-05-09T07:54:37.090690+0000","last_active":"2024-05-09T08:02:06.196088+0000","last_peered":"2024-05-09T08:02:06.196088+0000","last_clean":"2024-05-09T08:02:06.196088+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T08:02:06.196088+0000","last_undegraded":"2024-05-09T08:02:06.196088+0000","last_fullsized":"2024-05-09T08:02:06.196088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":3825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'651","reported_seq":670,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197138+0000","last_change":"2024-05-09T07:54:37.110834+0000","last_active":"2024-05-09T08:02:06.197138+0000","last_peered":"2024-05-09T08:02:06.197138+0000","last_clean":"2024-05-09T08:02:06.197138+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T08:02:06.197138+0000","last_undegraded":"2024-05-09T08:02:06.197138+0000","last_fullsized":"2024-05-09T08:02:06.197138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'630","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185714+0000","last_change":"2024-05-09T07:54:37.099545+0000","last_active":"2024-05-09T08:02:06.185714+0000","last_peered":"2024-05-09T08:02:06.185714+0000","last_clean":"2024-05-09T08:02:06.185714+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T08:02:06.185714+0000","last_undegraded":"2024-05-09T08:02:06.185714+0000","last_fullsized":"2024-05-09T08:02:06.185714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":3592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'592","reported_seq":611,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184552+0000","last_change":"2024-05-09T07:54:37.105054+0000","last_active":"2024-05-09T08:02:06.184552+0000","last_peered":"2024-05-09T08:02:06.184552+0000","last_clean":"2024-05-09T08:02:06.184552+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T08:02:06.184552+0000","last_undegraded":"2024-05-09T08:02:06.184552+0000","last_fullsized":"2024-05-09T08:02:06.184552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'619","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196667+0000","last_change":"2024-05-09T07:55:18.561520+0000","last_active":"2024-05-09T08:02:06.196667+0000","last_peered":"2024-05-09T08:02:06.196667+0000","last_clean":"2024-05-09T08:02:06.196667+0000","last_became_active":"2024-05-09T07:55:18.561115+0000","last_became_peered":"2024-05-09T07:55:18.561115+0000","last_unstale":"2024-05-09T08:02:06.196667+0000","last_undegraded":"2024-05-09T08:02:06.196667+0000","last_fullsized":"2024-05-09T08:02:06.196667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:48.961063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"23'657","reported_seq":676,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.178687+0000","last_change":"2024-05-09T07:54:37.110846+0000","last_active":"2024-05-09T08:02:06.178687+0000","last_peered":"2024-05-09T08:02:06.178687+0000","last_clean":"2024-05-09T08:02:06.178687+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T08:02:06.178687+0000","last_undegraded":"2024-05-09T08:02:06.178687+0000","last_fullsized":"2024-05-09T08:02:06.178687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'610","reported_seq":629,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.205481+0000","last_change":"2024-05-09T07:54:37.110392+0000","last_active":"2024-05-09T08:02:06.205481+0000","last_peered":"2024-05-09T08:02:06.205481+0000","last_clean":"2024-05-09T08:02:06.205481+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T08:02:06.205481+0000","last_undegraded":"2024-05-09T08:02:06.205481+0000","last_fullsized":"2024-05-09T08:02:06.205481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":3681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'647","reported_seq":666,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185643+0000","last_change":"2024-05-09T07:54:37.098797+0000","last_active":"2024-05-09T08:02:06.185643+0000","last_peered":"2024-05-09T08:02:06.185643+0000","last_clean":"2024-05-09T08:02:06.185643+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T08:02:06.185643+0000","last_undegraded":"2024-05-09T08:02:06.185643+0000","last_fullsized":"2024-05-09T08:02:06.185643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":798,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'606","reported_seq":625,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200517+0000","last_change":"2024-05-09T07:54:37.112262+0000","last_active":"2024-05-09T08:02:06.200517+0000","last_peered":"2024-05-09T08:02:06.200517+0000","last_clean":"2024-05-09T08:02:06.200517+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T08:02:06.200517+0000","last_undegraded":"2024-05-09T08:02:06.200517+0000","last_fullsized":"2024-05-09T08:02:06.200517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":3749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'666","reported_seq":685,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202404+0000","last_change":"2024-05-09T07:54:37.102723+0000","last_active":"2024-05-09T08:02:06.202404+0000","last_peered":"2024-05-09T08:02:06.202404+0000","last_clean":"2024-05-09T08:02:06.202404+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T08:02:06.202404+0000","last_undegraded":"2024-05-09T08:02:06.202404+0000","last_fullsized":"2024-05-09T08:02:06.202404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":3958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'636","reported_seq":655,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199477+0000","last_change":"2024-05-09T07:54:37.101021+0000","last_active":"2024-05-09T08:02:06.199477+0000","last_peered":"2024-05-09T08:02:06.199477+0000","last_clean":"2024-05-09T08:02:06.199477+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T08:02:06.199477+0000","last_undegraded":"2024-05-09T08:02:06.199477+0000","last_fullsized":"2024-05-09T08:02:06.199477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'718","reported_seq":737,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195868+0000","last_change":"2024-05-09T07:54:37.106515+0000","last_active":"2024-05-09T08:02:06.195868+0000","last_peered":"2024-05-09T08:02:06.195868+0000","last_clean":"2024-05-09T08:02:06.195868+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T08:02:06.195868+0000","last_undegraded":"2024-05-09T08:02:06.195868+0000","last_fullsized":"2024-05-09T08:02:06.195868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'618","reported_seq":637,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202609+0000","last_change":"2024-05-09T07:54:37.101475+0000","last_active":"2024-05-09T08:02:06.202609+0000","last_peered":"2024-05-09T08:02:06.202609+0000","last_clean":"2024-05-09T08:02:06.202609+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T08:02:06.202609+0000","last_undegraded":"2024-05-09T08:02:06.202609+0000","last_fullsized":"2024-05-09T08:02:06.202609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'588","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200874+0000","last_change":"2024-05-09T07:54:37.112908+0000","last_active":"2024-05-09T08:02:06.200874+0000","last_peered":"2024-05-09T08:02:06.200874+0000","last_clean":"2024-05-09T08:02:06.200874+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T08:02:06.200874+0000","last_undegraded":"2024-05-09T08:02:06.200874+0000","last_fullsized":"2024-05-09T08:02:06.200874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":3451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'618","reported_seq":637,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.204290+0000","last_change":"2024-05-09T07:54:37.109141+0000","last_active":"2024-05-09T08:02:06.204290+0000","last_peered":"2024-05-09T08:02:06.204290+0000","last_clean":"2024-05-09T08:02:06.204290+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T08:02:06.204290+0000","last_undegraded":"2024-05-09T08:02:06.204290+0000","last_fullsized":"2024-05-09T08:02:06.204290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'697","reported_seq":716,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194343+0000","last_change":"2024-05-09T07:54:37.103105+0000","last_active":"2024-05-09T08:02:06.194343+0000","last_peered":"2024-05-09T08:02:06.194343+0000","last_clean":"2024-05-09T08:02:06.194343+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T08:02:06.194343+0000","last_undegraded":"2024-05-09T08:02:06.194343+0000","last_fullsized":"2024-05-09T08:02:06.194343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":843,"num_write_kb":3831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'687","reported_seq":706,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.173818+0000","last_change":"2024-05-09T07:54:37.109657+0000","last_active":"2024-05-09T08:02:06.173818+0000","last_peered":"2024-05-09T08:02:06.173818+0000","last_clean":"2024-05-09T08:02:06.173818+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T08:02:06.173818+0000","last_undegraded":"2024-05-09T08:02:06.173818+0000","last_fullsized":"2024-05-09T08:02:06.173818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'658","reported_seq":677,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198966+0000","last_change":"2024-05-09T07:54:37.111278+0000","last_active":"2024-05-09T08:02:06.198966+0000","last_peered":"2024-05-09T08:02:06.198966+0000","last_clean":"2024-05-09T08:02:06.198966+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T08:02:06.198966+0000","last_undegraded":"2024-05-09T08:02:06.198966+0000","last_fullsized":"2024-05-09T08:02:06.198966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'616","reported_seq":635,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.193871+0000","last_change":"2024-05-09T07:54:37.099560+0000","last_active":"2024-05-09T08:02:06.193871+0000","last_peered":"2024-05-09T08:02:06.193871+0000","last_clean":"2024-05-09T08:02:06.193871+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T08:02:06.193871+0000","last_undegraded":"2024-05-09T08:02:06.193871+0000","last_fullsized":"2024-05-09T08:02:06.193871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:30.636185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":3676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'432","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.221372+0000","last_change":"2024-05-09T07:54:36.105511+0000","last_active":"2024-05-09T08:01:57.221372+0000","last_peered":"2024-05-09T08:01:57.221372+0000","last_clean":"2024-05-09T08:01:57.221372+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T08:01:57.221372+0000","last_undegraded":"2024-05-09T08:01:57.221372+0000","last_fullsized":"2024-05-09T08:01:57.221372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":480,"num_write_kb":8805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'556","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.206383+0000","last_change":"2024-05-09T07:54:37.110626+0000","last_active":"2024-05-09T08:02:06.206383+0000","last_peered":"2024-05-09T08:02:06.206383+0000","last_clean":"2024-05-09T08:02:06.206383+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T08:02:06.206383+0000","last_undegraded":"2024-05-09T08:02:06.206383+0000","last_fullsized":"2024-05-09T08:02:06.206383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":668,"num_write_kb":3012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'950","reported_seq":971,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.242506+0000","last_change":"2024-05-09T07:54:36.099522+0000","last_active":"2024-05-09T08:01:57.242506+0000","last_peered":"2024-05-09T08:01:57.242506+0000","last_clean":"2024-05-09T08:01:57.242506+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T08:01:57.242506+0000","last_undegraded":"2024-05-09T08:01:57.242506+0000","last_fullsized":"2024-05-09T08:01:57.242506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1015,"num_write_kb":29485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'176","reported_seq":197,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.954166+0000","last_change":"2024-05-09T07:54:36.103352+0000","last_active":"2024-05-09T08:01:53.954166+0000","last_peered":"2024-05-09T08:01:53.954166+0000","last_clean":"2024-05-09T08:01:53.954166+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T08:01:53.954166+0000","last_undegraded":"2024-05-09T08:01:53.954166+0000","last_fullsized":"2024-05-09T08:01:53.954166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":217,"num_write_kb":8642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'671","reported_seq":690,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198240+0000","last_change":"2024-05-09T07:54:37.113565+0000","last_active":"2024-05-09T08:02:06.198240+0000","last_peered":"2024-05-09T08:02:06.198240+0000","last_clean":"2024-05-09T08:02:06.198240+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T08:02:06.198240+0000","last_undegraded":"2024-05-09T08:02:06.198240+0000","last_fullsized":"2024-05-09T08:02:06.198240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'710","reported_seq":731,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.210384+0000","last_change":"2024-05-09T07:54:36.091893+0000","last_active":"2024-05-09T08:01:54.210384+0000","last_peered":"2024-05-09T08:01:54.210384+0000","last_clean":"2024-05-09T08:01:54.210384+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T08:01:54.210384+0000","last_undegraded":"2024-05-09T08:01:54.210384+0000","last_fullsized":"2024-05-09T08:01:54.210384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":749,"num_write_kb":37565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'621","reported_seq":640,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202751+0000","last_change":"2024-05-09T07:54:37.106284+0000","last_active":"2024-05-09T08:02:06.202751+0000","last_peered":"2024-05-09T08:02:06.202751+0000","last_clean":"2024-05-09T08:02:06.202751+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T08:02:06.202751+0000","last_undegraded":"2024-05-09T08:02:06.202751+0000","last_fullsized":"2024-05-09T08:02:06.202751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":3585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'140","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.141597+0000","last_change":"2024-05-09T07:54:36.100068+0000","last_active":"2024-05-09T08:02:06.141597+0000","last_peered":"2024-05-09T08:02:06.141597+0000","last_clean":"2024-05-09T08:02:06.141597+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T08:02:06.141597+0000","last_undegraded":"2024-05-09T08:02:06.141597+0000","last_fullsized":"2024-05-09T08:02:06.141597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10381600,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":185,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'661","reported_seq":673,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.191831+0000","last_change":"2024-05-09T07:55:18.903031+0000","last_active":"2024-05-09T08:02:06.191831+0000","last_peered":"2024-05-09T08:02:06.191831+0000","last_clean":"2024-05-09T08:02:06.191831+0000","last_became_active":"2024-05-09T07:55:18.902706+0000","last_became_peered":"2024-05-09T07:55:18.902706+0000","last_unstale":"2024-05-09T08:02:06.191831+0000","last_undegraded":"2024-05-09T08:02:06.191831+0000","last_fullsized":"2024-05-09T08:02:06.191831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'443","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.201493+0000","last_change":"2024-05-09T07:54:36.100368+0000","last_active":"2024-05-09T08:01:56.201493+0000","last_peered":"2024-05-09T08:01:56.201493+0000","last_clean":"2024-05-09T08:01:56.201493+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T08:01:56.201493+0000","last_undegraded":"2024-05-09T08:01:56.201493+0000","last_fullsized":"2024-05-09T08:01:56.201493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":490,"num_write_kb":25148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'591","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199607+0000","last_change":"2024-05-09T07:54:37.107847+0000","last_active":"2024-05-09T08:02:06.199607+0000","last_peered":"2024-05-09T08:02:06.199607+0000","last_clean":"2024-05-09T08:02:06.199607+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T08:02:06.199607+0000","last_undegraded":"2024-05-09T08:02:06.199607+0000","last_fullsized":"2024-05-09T08:02:06.199607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'768","reported_seq":789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.276875+0000","last_change":"2024-05-09T07:54:36.101694+0000","last_active":"2024-05-09T08:01:57.276875+0000","last_peered":"2024-05-09T08:01:57.276875+0000","last_clean":"2024-05-09T08:01:57.276875+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T08:01:57.276875+0000","last_undegraded":"2024-05-09T08:01:57.276875+0000","last_fullsized":"2024-05-09T08:01:57.276875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":817,"num_write_kb":21310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'594","reported_seq":613,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195234+0000","last_change":"2024-05-09T07:54:37.098733+0000","last_active":"2024-05-09T08:02:06.195234+0000","last_peered":"2024-05-09T08:02:06.195234+0000","last_clean":"2024-05-09T08:02:06.195234+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T08:02:06.195234+0000","last_undegraded":"2024-05-09T08:02:06.195234+0000","last_fullsized":"2024-05-09T08:02:06.195234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:15.571989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'821","reported_seq":842,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.249921+0000","last_change":"2024-05-09T07:54:36.103096+0000","last_active":"2024-05-09T08:01:54.249921+0000","last_peered":"2024-05-09T08:01:54.249921+0000","last_clean":"2024-05-09T08:01:54.249921+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T08:01:54.249921+0000","last_undegraded":"2024-05-09T08:01:54.249921+0000","last_fullsized":"2024-05-09T08:01:54.249921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":851,"num_write_kb":25125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'612","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185887+0000","last_change":"2024-05-09T07:54:37.101875+0000","last_active":"2024-05-09T08:02:06.185887+0000","last_peered":"2024-05-09T08:02:06.185887+0000","last_clean":"2024-05-09T08:02:06.185887+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T08:02:06.185887+0000","last_undegraded":"2024-05-09T08:02:06.185887+0000","last_fullsized":"2024-05-09T08:02:06.185887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'702","reported_seq":723,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:49.153612+0000","last_change":"2024-05-09T07:54:36.090977+0000","last_active":"2024-05-09T08:01:49.153612+0000","last_peered":"2024-05-09T08:01:49.153612+0000","last_clean":"2024-05-09T08:01:49.153612+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T08:01:49.153612+0000","last_undegraded":"2024-05-09T08:01:49.153612+0000","last_fullsized":"2024-05-09T08:01:49.153612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:17.768144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":750,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'628","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200287+0000","last_change":"2024-05-09T07:54:37.105813+0000","last_active":"2024-05-09T08:02:06.200287+0000","last_peered":"2024-05-09T08:02:06.200287+0000","last_clean":"2024-05-09T08:02:06.200287+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T08:02:06.200287+0000","last_undegraded":"2024-05-09T08:02:06.200287+0000","last_fullsized":"2024-05-09T08:02:06.200287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:02.185354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'74","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.208101+0000","last_change":"2024-05-09T07:54:36.102510+0000","last_active":"2024-05-09T08:01:56.208101+0000","last_peered":"2024-05-09T08:01:56.208101+0000","last_clean":"2024-05-09T08:01:56.208101+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T08:01:56.208101+0000","last_undegraded":"2024-05-09T08:01:56.208101+0000","last_fullsized":"2024-05-09T08:01:56.208101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":148,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195420+0000","last_change":"2024-05-09T07:54:37.105015+0000","last_active":"2024-05-09T08:02:06.195420+0000","last_peered":"2024-05-09T08:02:06.195420+0000","last_clean":"2024-05-09T08:02:06.195420+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T08:02:06.195420+0000","last_undegraded":"2024-05-09T08:02:06.195420+0000","last_fullsized":"2024-05-09T08:02:06.195420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":3484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'101","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.227008+0000","last_change":"2024-05-09T07:54:36.103721+0000","last_active":"2024-05-09T08:01:57.227008+0000","last_peered":"2024-05-09T08:01:57.227008+0000","last_clean":"2024-05-09T08:01:57.227008+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T08:01:57.227008+0000","last_undegraded":"2024-05-09T08:01:57.227008+0000","last_fullsized":"2024-05-09T08:01:57.227008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":161,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'724","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.191153+0000","last_change":"2024-05-09T07:54:37.111215+0000","last_active":"2024-05-09T08:02:06.191153+0000","last_peered":"2024-05-09T08:02:06.191153+0000","last_clean":"2024-05-09T08:02:06.191153+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T08:02:06.191153+0000","last_undegraded":"2024-05-09T08:02:06.191153+0000","last_fullsized":"2024-05-09T08:02:06.191153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":3636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'183","reported_seq":204,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:52.188023+0000","last_change":"2024-05-09T07:54:36.098598+0000","last_active":"2024-05-09T08:01:52.188023+0000","last_peered":"2024-05-09T08:01:52.188023+0000","last_clean":"2024-05-09T08:01:52.188023+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T08:01:52.188023+0000","last_undegraded":"2024-05-09T08:01:52.188023+0000","last_fullsized":"2024-05-09T08:01:52.188023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":241,"num_write_kb":8581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'724","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.190619+0000","last_change":"2024-05-09T07:54:37.102764+0000","last_active":"2024-05-09T08:02:06.190619+0000","last_peered":"2024-05-09T08:02:06.190619+0000","last_clean":"2024-05-09T08:02:06.190619+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T08:02:06.190619+0000","last_undegraded":"2024-05-09T08:02:06.190619+0000","last_fullsized":"2024-05-09T08:02:06.190619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":3956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'289","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.201064+0000","last_change":"2024-05-09T07:54:36.092365+0000","last_active":"2024-05-09T08:01:56.201064+0000","last_peered":"2024-05-09T08:01:56.201064+0000","last_clean":"2024-05-09T08:01:56.201064+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T08:01:56.201064+0000","last_undegraded":"2024-05-09T08:01:56.201064+0000","last_fullsized":"2024-05-09T08:01:56.201064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":360,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'586","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192923+0000","last_change":"2024-05-09T07:54:37.100214+0000","last_active":"2024-05-09T08:02:06.192923+0000","last_peered":"2024-05-09T08:02:06.192923+0000","last_clean":"2024-05-09T08:02:06.192923+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T08:02:06.192923+0000","last_undegraded":"2024-05-09T08:02:06.192923+0000","last_fullsized":"2024-05-09T08:02:06.192923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":3597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'316","reported_seq":337,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.200234+0000","last_change":"2024-05-09T07:54:36.100004+0000","last_active":"2024-05-09T08:01:56.200234+0000","last_peered":"2024-05-09T08:01:56.200234+0000","last_clean":"2024-05-09T08:01:56.200234+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T08:01:56.200234+0000","last_undegraded":"2024-05-09T08:01:56.200234+0000","last_fullsized":"2024-05-09T08:01:56.200234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":351,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'580","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197234+0000","last_change":"2024-05-09T07:54:37.100879+0000","last_active":"2024-05-09T08:02:06.197234+0000","last_peered":"2024-05-09T08:02:06.197234+0000","last_clean":"2024-05-09T08:02:06.197234+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T08:02:06.197234+0000","last_undegraded":"2024-05-09T08:02:06.197234+0000","last_fullsized":"2024-05-09T08:02:06.197234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'462","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.295843+0000","last_change":"2024-05-09T07:54:36.099594+0000","last_active":"2024-05-09T08:01:55.295843+0000","last_peered":"2024-05-09T08:01:55.295843+0000","last_clean":"2024-05-09T08:01:55.295843+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T08:01:55.295843+0000","last_undegraded":"2024-05-09T08:01:55.295843+0000","last_fullsized":"2024-05-09T08:01:55.295843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":512,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'682","reported_seq":695,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182300+0000","last_change":"2024-05-09T07:55:18.559305+0000","last_active":"2024-05-09T08:02:06.182300+0000","last_peered":"2024-05-09T08:02:06.182300+0000","last_clean":"2024-05-09T08:02:06.182300+0000","last_became_active":"2024-05-09T07:55:18.558939+0000","last_became_peered":"2024-05-09T07:55:18.558939+0000","last_unstale":"2024-05-09T08:02:06.182300+0000","last_undegraded":"2024-05-09T08:02:06.182300+0000","last_fullsized":"2024-05-09T08:02:06.182300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"23'248","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.420616+0000","last_change":"2024-05-09T07:54:36.097398+0000","last_active":"2024-05-09T08:01:54.420616+0000","last_peered":"2024-05-09T08:01:54.420616+0000","last_clean":"2024-05-09T08:01:54.420616+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T08:01:54.420616+0000","last_undegraded":"2024-05-09T08:01:54.420616+0000","last_fullsized":"2024-05-09T08:01:54.420616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":299,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'588","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.187188+0000","last_change":"2024-05-09T07:54:37.108574+0000","last_active":"2024-05-09T08:02:06.187188+0000","last_peered":"2024-05-09T08:02:06.187188+0000","last_clean":"2024-05-09T08:02:06.187188+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T08:02:06.187188+0000","last_undegraded":"2024-05-09T08:02:06.187188+0000","last_fullsized":"2024-05-09T08:02:06.187188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":3417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T07:58:28.929423+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:58:28.929423+0000","last_peered":"2024-05-09T07:58:28.929423+0000","last_clean":"2024-05-09T07:58:28.929423+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:58:28.929423+0000","last_undegraded":"2024-05-09T07:58:28.929423+0000","last_fullsized":"2024-05-09T07:58:28.929423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'199","reported_seq":220,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.423265+0000","last_change":"2024-05-09T07:54:36.097635+0000","last_active":"2024-05-09T08:01:54.423265+0000","last_peered":"2024-05-09T08:01:54.423265+0000","last_clean":"2024-05-09T08:01:54.423265+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T08:01:54.423265+0000","last_undegraded":"2024-05-09T08:01:54.423265+0000","last_fullsized":"2024-05-09T08:01:54.423265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":237,"num_write_kb":12549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'566","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192763+0000","last_change":"2024-05-09T07:54:37.111470+0000","last_active":"2024-05-09T08:02:06.192763+0000","last_peered":"2024-05-09T08:02:06.192763+0000","last_clean":"2024-05-09T08:02:06.192763+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T08:02:06.192763+0000","last_undegraded":"2024-05-09T08:02:06.192763+0000","last_fullsized":"2024-05-09T08:02:06.192763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":3530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'754","reported_seq":775,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.206375+0000","last_change":"2024-05-09T07:54:36.107162+0000","last_active":"2024-05-09T08:01:56.206375+0000","last_peered":"2024-05-09T08:01:56.206375+0000","last_clean":"2024-05-09T08:01:56.206375+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T08:01:56.206375+0000","last_undegraded":"2024-05-09T08:01:56.206375+0000","last_fullsized":"2024-05-09T08:01:56.206375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":793,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184193+0000","last_change":"2024-05-09T07:54:37.102062+0000","last_active":"2024-05-09T08:02:06.184193+0000","last_peered":"2024-05-09T08:02:06.184193+0000","last_clean":"2024-05-09T08:02:06.184193+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T08:02:06.184193+0000","last_undegraded":"2024-05-09T08:02:06.184193+0000","last_fullsized":"2024-05-09T08:02:06.184193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:32.555846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":3702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'938","reported_seq":1645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:58.206696+0000","last_change":"2024-05-09T07:54:36.100227+0000","last_active":"2024-05-09T08:01:58.206696+0000","last_peered":"2024-05-09T08:01:58.206696+0000","last_clean":"2024-05-09T08:01:58.206696+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T08:01:58.206696+0000","last_undegraded":"2024-05-09T08:01:58.206696+0000","last_fullsized":"2024-05-09T08:01:58.206696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512596,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":706,"num_read_kb":1945,"num_write":995,"num_write_kb":14766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194027+0000","last_change":"2024-05-09T07:54:37.109167+0000","last_active":"2024-05-09T08:02:06.194027+0000","last_peered":"2024-05-09T08:02:06.194027+0000","last_clean":"2024-05-09T08:02:06.194027+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T08:02:06.194027+0000","last_undegraded":"2024-05-09T08:02:06.194027+0000","last_fullsized":"2024-05-09T08:02:06.194027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":3437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'650","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.250789+0000","last_change":"2024-05-09T07:54:36.100426+0000","last_active":"2024-05-09T08:01:54.250789+0000","last_peered":"2024-05-09T08:01:54.250789+0000","last_clean":"2024-05-09T08:01:54.250789+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T08:01:54.250789+0000","last_undegraded":"2024-05-09T08:01:54.250789+0000","last_fullsized":"2024-05-09T08:01:54.250789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":708,"num_write_kb":29261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'605","reported_seq":624,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194904+0000","last_change":"2024-05-09T07:54:37.108794+0000","last_active":"2024-05-09T08:02:06.194904+0000","last_peered":"2024-05-09T08:02:06.194904+0000","last_clean":"2024-05-09T08:02:06.194904+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T08:02:06.194904+0000","last_undegraded":"2024-05-09T08:02:06.194904+0000","last_fullsized":"2024-05-09T08:02:06.194904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:43.498827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'182","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.203877+0000","last_change":"2024-05-09T07:54:36.104155+0000","last_active":"2024-05-09T08:01:56.203877+0000","last_peered":"2024-05-09T08:01:56.203877+0000","last_clean":"2024-05-09T08:01:56.203877+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T08:01:56.203877+0000","last_undegraded":"2024-05-09T08:01:56.203877+0000","last_fullsized":"2024-05-09T08:01:56.203877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":263,"num_write_kb":8685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'644","reported_seq":663,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194002+0000","last_change":"2024-05-09T07:54:37.103562+0000","last_active":"2024-05-09T08:02:06.194002+0000","last_peered":"2024-05-09T08:02:06.194002+0000","last_clean":"2024-05-09T08:02:06.194002+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T08:02:06.194002+0000","last_undegraded":"2024-05-09T08:02:06.194002+0000","last_fullsized":"2024-05-09T08:02:06.194002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'488","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.207750+0000","last_change":"2024-05-09T07:54:36.106399+0000","last_active":"2024-05-09T08:01:56.207750+0000","last_peered":"2024-05-09T08:01:56.207750+0000","last_clean":"2024-05-09T08:01:56.207750+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T08:01:56.207750+0000","last_undegraded":"2024-05-09T08:01:56.207750+0000","last_fullsized":"2024-05-09T08:01:56.207750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":548,"num_write_kb":21106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'589","reported_seq":608,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196818+0000","last_change":"2024-05-09T07:54:37.105988+0000","last_active":"2024-05-09T08:02:06.196818+0000","last_peered":"2024-05-09T08:02:06.196818+0000","last_clean":"2024-05-09T08:02:06.196818+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T08:02:06.196818+0000","last_undegraded":"2024-05-09T08:02:06.196818+0000","last_fullsized":"2024-05-09T08:02:06.196818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":3737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'475","reported_seq":496,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:00.873819+0000","last_change":"2024-05-09T07:54:36.101002+0000","last_active":"2024-05-09T08:02:00.873819+0000","last_peered":"2024-05-09T08:02:00.873819+0000","last_clean":"2024-05-09T08:02:00.873819+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T08:02:00.873819+0000","last_undegraded":"2024-05-09T08:02:00.873819+0000","last_fullsized":"2024-05-09T08:02:00.873819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1199,"num_write_kb":9658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'541","reported_seq":560,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184733+0000","last_change":"2024-05-09T07:54:37.100183+0000","last_active":"2024-05-09T08:02:06.184733+0000","last_peered":"2024-05-09T08:02:06.184733+0000","last_clean":"2024-05-09T08:02:06.184733+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T08:02:06.184733+0000","last_undegraded":"2024-05-09T08:02:06.184733+0000","last_fullsized":"2024-05-09T08:02:06.184733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'250","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.209315+0000","last_change":"2024-05-09T07:54:36.105813+0000","last_active":"2024-05-09T08:01:56.209315+0000","last_peered":"2024-05-09T08:01:56.209315+0000","last_clean":"2024-05-09T08:01:56.209315+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T08:01:56.209315+0000","last_undegraded":"2024-05-09T08:01:56.209315+0000","last_fullsized":"2024-05-09T08:01:56.209315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":329,"num_write_kb":8747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'732","reported_seq":751,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.201728+0000","last_change":"2024-05-09T07:54:37.107782+0000","last_active":"2024-05-09T08:02:06.201728+0000","last_peered":"2024-05-09T08:02:06.201728+0000","last_clean":"2024-05-09T08:02:06.201728+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T08:02:06.201728+0000","last_undegraded":"2024-05-09T08:02:06.201728+0000","last_fullsized":"2024-05-09T08:02:06.201728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'189","reported_seq":210,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.297656+0000","last_change":"2024-05-09T07:54:36.106409+0000","last_active":"2024-05-09T08:01:55.297656+0000","last_peered":"2024-05-09T08:01:55.297656+0000","last_clean":"2024-05-09T08:01:55.297656+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T08:01:55.297656+0000","last_undegraded":"2024-05-09T08:01:55.297656+0000","last_fullsized":"2024-05-09T08:01:55.297656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":230,"num_write_kb":8511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'679","reported_seq":698,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179837+0000","last_change":"2024-05-09T07:54:37.104920+0000","last_active":"2024-05-09T08:02:06.179837+0000","last_peered":"2024-05-09T08:02:06.179837+0000","last_clean":"2024-05-09T08:02:06.179837+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T08:02:06.179837+0000","last_undegraded":"2024-05-09T08:02:06.179837+0000","last_fullsized":"2024-05-09T08:02:06.179837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":3995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'230","reported_seq":251,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:52.209441+0000","last_change":"2024-05-09T07:54:36.105662+0000","last_active":"2024-05-09T08:01:52.209441+0000","last_peered":"2024-05-09T08:01:52.209441+0000","last_clean":"2024-05-09T08:01:52.209441+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T08:01:52.209441+0000","last_undegraded":"2024-05-09T08:01:52.209441+0000","last_fullsized":"2024-05-09T08:01:52.209441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":261,"num_write_kb":12547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'635","reported_seq":654,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200088+0000","last_change":"2024-05-09T07:54:37.103640+0000","last_active":"2024-05-09T08:02:06.200088+0000","last_peered":"2024-05-09T08:02:06.200088+0000","last_clean":"2024-05-09T08:02:06.200088+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T08:02:06.200088+0000","last_undegraded":"2024-05-09T08:02:06.200088+0000","last_fullsized":"2024-05-09T08:02:06.200088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'493","reported_seq":514,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.222839+0000","last_change":"2024-05-09T07:54:36.102636+0000","last_active":"2024-05-09T08:01:57.222839+0000","last_peered":"2024-05-09T08:01:57.222839+0000","last_clean":"2024-05-09T08:01:57.222839+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T08:01:57.222839+0000","last_undegraded":"2024-05-09T08:01:57.222839+0000","last_fullsized":"2024-05-09T08:01:57.222839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":567,"num_write_kb":25391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'646","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.201248+0000","last_change":"2024-05-09T07:55:18.902612+0000","last_active":"2024-05-09T08:02:06.201248+0000","last_peered":"2024-05-09T08:02:06.201248+0000","last_clean":"2024-05-09T08:02:06.201248+0000","last_became_active":"2024-05-09T07:55:18.902275+0000","last_became_peered":"2024-05-09T07:55:18.902275+0000","last_unstale":"2024-05-09T08:02:06.201248+0000","last_undegraded":"2024-05-09T08:02:06.201248+0000","last_fullsized":"2024-05-09T08:02:06.201248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:54.608551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":3818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"23'887","reported_seq":908,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:50.185785+0000","last_change":"2024-05-09T07:54:36.104367+0000","last_active":"2024-05-09T08:01:50.185785+0000","last_peered":"2024-05-09T08:01:50.185785+0000","last_clean":"2024-05-09T08:01:50.185785+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T08:01:50.185785+0000","last_undegraded":"2024-05-09T08:01:50.185785+0000","last_fullsized":"2024-05-09T08:01:50.185785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":934,"num_write_kb":29264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'642","reported_seq":661,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.180045+0000","last_change":"2024-05-09T07:54:37.111038+0000","last_active":"2024-05-09T08:02:06.180045+0000","last_peered":"2024-05-09T08:02:06.180045+0000","last_clean":"2024-05-09T08:02:06.180045+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T08:02:06.180045+0000","last_undegraded":"2024-05-09T08:02:06.180045+0000","last_fullsized":"2024-05-09T08:02:06.180045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":3781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'597","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.178625+0000","last_change":"2024-05-09T07:55:18.558479+0000","last_active":"2024-05-09T08:02:06.178625+0000","last_peered":"2024-05-09T08:02:06.178625+0000","last_clean":"2024-05-09T08:02:06.178625+0000","last_became_active":"2024-05-09T07:55:18.558037+0000","last_became_peered":"2024-05-09T07:55:18.558037+0000","last_unstale":"2024-05-09T08:02:06.178625+0000","last_undegraded":"2024-05-09T08:02:06.178625+0000","last_fullsized":"2024-05-09T08:02:06.178625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'190","reported_seq":211,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.240539+0000","last_change":"2024-05-09T07:54:36.105726+0000","last_active":"2024-05-09T08:01:57.240539+0000","last_peered":"2024-05-09T08:01:57.240539+0000","last_clean":"2024-05-09T08:01:57.240539+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T08:01:57.240539+0000","last_undegraded":"2024-05-09T08:01:57.240539+0000","last_fullsized":"2024-05-09T08:01:57.240539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":262,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'590","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.172605+0000","last_change":"2024-05-09T07:54:37.092061+0000","last_active":"2024-05-09T08:02:06.172605+0000","last_peered":"2024-05-09T08:02:06.172605+0000","last_clean":"2024-05-09T08:02:06.172605+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T08:02:06.172605+0000","last_undegraded":"2024-05-09T08:02:06.172605+0000","last_fullsized":"2024-05-09T08:02:06.172605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1115","reported_seq":1136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.157658+0000","last_change":"2024-05-09T07:54:36.106635+0000","last_active":"2024-05-09T08:01:53.157658+0000","last_peered":"2024-05-09T08:01:53.157658+0000","last_clean":"2024-05-09T08:01:53.157658+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T08:01:53.157658+0000","last_undegraded":"2024-05-09T08:01:53.157658+0000","last_fullsized":"2024-05-09T08:01:53.157658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1161,"num_write_kb":29324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'532","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199819+0000","last_change":"2024-05-09T07:54:37.108470+0000","last_active":"2024-05-09T08:02:06.199819+0000","last_peered":"2024-05-09T08:02:06.199819+0000","last_clean":"2024-05-09T08:02:06.199819+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T08:02:06.199819+0000","last_undegraded":"2024-05-09T08:02:06.199819+0000","last_fullsized":"2024-05-09T08:02:06.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":3333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'708","reported_seq":729,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.297864+0000","last_change":"2024-05-09T07:54:36.102502+0000","last_active":"2024-05-09T08:01:55.297864+0000","last_peered":"2024-05-09T08:01:55.297864+0000","last_clean":"2024-05-09T08:01:55.297864+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T08:01:55.297864+0000","last_undegraded":"2024-05-09T08:01:55.297864+0000","last_fullsized":"2024-05-09T08:01:55.297864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":745,"num_write_kb":29116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'614","reported_seq":633,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194093+0000","last_change":"2024-05-09T07:54:37.104598+0000","last_active":"2024-05-09T08:02:06.194093+0000","last_peered":"2024-05-09T08:02:06.194093+0000","last_clean":"2024-05-09T08:02:06.194093+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T08:02:06.194093+0000","last_undegraded":"2024-05-09T08:02:06.194093+0000","last_fullsized":"2024-05-09T08:02:06.194093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'491","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.157976+0000","last_change":"2024-05-09T07:54:36.101744+0000","last_active":"2024-05-09T08:01:53.157976+0000","last_peered":"2024-05-09T08:01:53.157976+0000","last_clean":"2024-05-09T08:01:53.157976+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T08:01:53.157976+0000","last_undegraded":"2024-05-09T08:01:53.157976+0000","last_fullsized":"2024-05-09T08:01:53.157976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":559,"num_write_kb":8798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48848,"num_write_kb":235793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39700,"ondisk_log_size":39700,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":150307698,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1306,"num_read_kb":1945,"num_write":17417,"num_write_kb":525877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":300679168,"data_stored":300615396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15054,"ondisk_log_size":15054,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542241,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102712,"kb_used_data":53488,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94269128,"statfs":{"total":96636764160,"available":96531587072,"internally_reserved":0,"allocated":54771712,"data_stored":54613426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542241,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":21304,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":21815296,"data_stored":21649840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100920,"kb_used_data":29488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270920,"statfs":{"total":96636764160,"available":96533422080,"internally_reserved":0,"allocated":30195712,"data_stored":30038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122772,"kb_used_data":47244,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94249068,"statfs":{"total":96636764160,"available":96511045632,"internally_reserved":0,"allocated":48377856,"data_stored":48218322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108752,"kb_used_data":59528,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94263088,"statfs":{"total":96636764160,"available":96525402112,"internally_reserved":0,"allocated":60956672,"data_stored":60800652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116668,"kb_used_data":45300,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94255172,"statfs":{"total":96636764160,"available":96517296128,"internally_reserved":0,"allocated":46387200,"data_stored":46224784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101824,"kb_used_data":26296,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94270016,"statfs":{"total":96636764160,"available":96532496384,"internally_reserved":0,"allocated":26927104,"data_stored":26766406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71544,"kb_used_data":14000,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300296,"statfs":{"total":96636764160,"available":96563503104,"internally_reserved":0,"allocated":14336000,"data_stored":14182822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":54534144,"data_stored":54526112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14098432,"data_stored":14095508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26689536,"data_stored":26679092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":60719104,"data_stored":60713338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48140288,"data_stored":48131008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T08:02:13.427 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T08:02:13.427 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T08:02:13.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.547+0000 7fe0a9cae640 1 Processor -- start 2024-05-09T08:02:13.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.547+0000 7fe0a9cae640 1 -- start start 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a9cae640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe0a40af1b0 0x7fe0a40af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a9cae640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0a40b6030 0x7fe0a40b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a9cae640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a40b3770 con 0x7fe0a40b5bf0 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a9cae640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a40b3d80 con 0x7fe0a40af1b0 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a9cae640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a40b0ed0 con 0x7fe0a40b6030 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a37fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe0a40af1b0 0x7fe0a40af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a37fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe0a40af1b0 0x7fe0a40af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47026/0 (socket says 172.21.15.87:47026) 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a2ffd640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe0a40b5bf0 0x7fe0a40b28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59516/0 (socket says 172.21.15.87:59516) 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a37fe640 1 -- 172.21.15.87:0/50319450 learned_addr learned my addr 172.21.15.87:0/50319450 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a3fff640 1 --2- 172.21.15.87:0/50319450 >> v2:172.21.15.110:3300/0 conn(0x7fe0a40b6030 0x7fe0a40b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a37fe640 1 -- 172.21.15.87:0/50319450 >> v2:172.21.15.110:3300/0 conn(0x7fe0a40b6030 msgr2=0x7fe0a40b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:13.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a37fe640 1 --2- 172.21.15.87:0/50319450 >> v2:172.21.15.110:3300/0 conn(0x7fe0a40b6030 0x7fe0a40b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a37fe640 1 -- 172.21.15.87:0/50319450 >> v1:172.21.15.87:6789/0 conn(0x7fe0a40b5bf0 legacy=0x7fe0a40b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a37fe640 1 -- 172.21.15.87:0/50319450 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a40b5530 con 0x7fe0a40af1b0 2024-05-09T08:02:13.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a27fc640 1 -- 172.21.15.87:0/50319450 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568384767 0 0) 0x7fe0a40b3770 con 0x7fe0a40b5bf0 2024-05-09T08:02:13.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.548+0000 7fe0a3fff640 1 --2- 172.21.15.87:0/50319450 >> v2:172.21.15.110:3300/0 conn(0x7fe0a40b6030 0x7fe0a40b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:13.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.549+0000 7fe0a37fe640 1 --2- 172.21.15.87:0/50319450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40af1b0 0x7fe0a40af900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40b50a0 tx=0x7fe09402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69f5241b1290a21 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:13.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.549+0000 7fe0a27fc640 1 -- 172.21.15.87:0/50319450 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094036070 con 0x7fe0a40af1b0 2024-05-09T08:02:13.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.549+0000 7fe0a27fc640 1 -- 172.21.15.87:0/50319450 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe094031600 con 0x7fe0a40af1b0 2024-05-09T08:02:13.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.549+0000 7fe0a27fc640 1 -- 172.21.15.87:0/50319450 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0940319d0 con 0x7fe0a40af1b0 2024-05-09T08:02:13.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.550+0000 7fe0a9cae640 1 -- 172.21.15.87:0/50319450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40af1b0 msgr2=0x7fe0a40af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.550+0000 7fe0a9cae640 1 --2- 172.21.15.87:0/50319450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40af1b0 0x7fe0a40af900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40b50a0 tx=0x7fe09402a610 comp rx=0 tx=0).stop 2024-05-09T08:02:13.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.550+0000 7fe0a9cae640 1 -- 172.21.15.87:0/50319450 shutdown_connections 2024-05-09T08:02:13.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.550+0000 7fe0a9cae640 1 --2- 172.21.15.87:0/50319450 >> v2:172.21.15.110:3300/0 conn(0x7fe0a40b6030 0x7fe0a40b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.550+0000 7fe0a9cae640 1 --2- 172.21.15.87:0/50319450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40af1b0 0x7fe0a40af900 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.550+0000 7fe0a9cae640 1 -- 172.21.15.87:0/50319450 >> 172.21.15.87:0/50319450 conn(0x7fe0a406c6a0 msgr2=0x7fe0a406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.550+0000 7fe0a9cae640 1 -- 172.21.15.87:0/50319450 shutdown_connections 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.550+0000 7fe0a9cae640 1 -- 172.21.15.87:0/50319450 wait complete. 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.551+0000 7fe0a9cae640 1 Processor -- start 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.551+0000 7fe0a9cae640 1 -- start start 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a9cae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a40af1b0 0x7fe0a41e0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a9cae640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a40b5bf0 0x7fe0a4148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a9cae640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40b6030 0x7fe0a406fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a9cae640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a40adfb0 con 0x7fe0a40b6030 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a9cae640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a40ade30 con 0x7fe0a40af1b0 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a9cae640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a40b2ff0 con 0x7fe0a40b5bf0 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40b6030 0x7fe0a406fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40b6030 0x7fe0a406fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47038/0 (socket says 172.21.15.87:47038) 2024-05-09T08:02:13.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a3fff640 1 -- 172.21.15.87:0/1018597758 learned_addr learned my addr 172.21.15.87:0/1018597758 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a37fe640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a40af1b0 0x7fe0a41e0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a2ffd640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a40b5bf0 0x7fe0a4148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a3fff640 1 -- 172.21.15.87:0/1018597758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a40b5bf0 msgr2=0x7fe0a4148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a3fff640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a40b5bf0 0x7fe0a4148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a3fff640 1 -- 172.21.15.87:0/1018597758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a40af1b0 msgr2=0x7fe0a41e0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a3fff640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a40af1b0 0x7fe0a41e0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a3fff640 1 -- 172.21.15.87:0/1018597758 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a4070f40 con 0x7fe0a40b6030 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a3fff640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40b6030 0x7fe0a406fac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00d5c0 tx=0x7fe09c00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe08bfff640 1 -- 172.21.15.87:0/1018597758 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c004030 con 0x7fe0a40b6030 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe08bfff640 1 -- 172.21.15.87:0/1018597758 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09c0041d0 con 0x7fe0a40b6030 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a4071220 con 0x7fe0a40b6030 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe08bfff640 1 -- 172.21.15.87:0/1018597758 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c003610 con 0x7fe0a40b6030 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.552+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a4144e00 con 0x7fe0a40b6030 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.554+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a40691f0 con 0x7fe0a40b6030 2024-05-09T08:02:13.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.554+0000 7fe08bfff640 1 -- 172.21.15.87:0/1018597758 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe09c0037b0 con 0x7fe0a40b6030 2024-05-09T08:02:13.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.554+0000 7fe08bfff640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe09006be60 0x7fe09006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.554+0000 7fe0a37fe640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe09006be60 0x7fe09006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.555+0000 7fe08bfff640 1 -- 172.21.15.87:0/1018597758 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe09c08b0c0 con 0x7fe0a40b6030 2024-05-09T08:02:13.573 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.555+0000 7fe0a37fe640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe09006be60 0x7fe09006e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe094033000 tx=0x7fe094009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:13.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.559+0000 7fe08bfff640 1 -- 172.21.15.87:0/1018597758 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe09c059a70 con 0x7fe0a40b6030 2024-05-09T08:02:13.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.730+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0a40b7a70 con 0x7fe09006be60 2024-05-09T08:02:13.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.736+0000 7fe08bfff640 1 -- 172.21.15.87:0/1018597758 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253589 (secure 0 0 0) 0x7fe0a40b7a70 con 0x7fe09006be60 2024-05-09T08:02:13.755 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:13.756 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe09006be60 msgr2=0x7fe09006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe09006be60 0x7fe09006e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe094033000 tx=0x7fe094009000 comp rx=0 tx=0).stop 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40b6030 msgr2=0x7fe0a406fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40b6030 0x7fe0a406fac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00d5c0 tx=0x7fe09c00da80 comp rx=0 tx=0).stop 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 shutdown_connections 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe09006be60 0x7fe09006e320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a40b5bf0 0x7fe0a4148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0a40b6030 0x7fe0a406fac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 --2- 172.21.15.87:0/1018597758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a40af1b0 0x7fe0a41e0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 >> 172.21.15.87:0/1018597758 conn(0x7fe0a406c6a0 msgr2=0x7fe0a40b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 shutdown_connections 2024-05-09T08:02:13.758 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.739+0000 7fe0a9cae640 1 -- 172.21.15.87:0/1018597758 wait complete. 2024-05-09T08:02:13.768 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-05-09T08:02:12.984978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":150898066,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1422,"num_read_kb":2045,"num_write":66424,"num_write_kb":764086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54871,"ondisk_log_size":54871,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":804040,"kb_used_data":296648,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":754170680,"statfs":{"total":773094113280,"available":772270776320,"internally_reserved":0,"allocated":303767552,"data_stored":302494644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":519491121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":217371,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003085"},"pg_stats":[{"pgid":"3.3f","version":"23'599","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192547+0000","last_change":"2024-05-09T07:54:37.107065+0000","last_active":"2024-05-09T08:02:06.192547+0000","last_peered":"2024-05-09T08:02:06.192547+0000","last_clean":"2024-05-09T08:02:06.192547+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T08:02:06.192547+0000","last_undegraded":"2024-05-09T08:02:06.192547+0000","last_fullsized":"2024-05-09T08:02:06.192547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'629","reported_seq":648,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197366+0000","last_change":"2024-05-09T07:54:37.109460+0000","last_active":"2024-05-09T08:02:06.197366+0000","last_peered":"2024-05-09T08:02:06.197366+0000","last_clean":"2024-05-09T08:02:06.197366+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T08:02:06.197366+0000","last_undegraded":"2024-05-09T08:02:06.197366+0000","last_fullsized":"2024-05-09T08:02:06.197366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":3580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'592","reported_seq":611,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198154+0000","last_change":"2024-05-09T07:54:37.108923+0000","last_active":"2024-05-09T08:02:06.198154+0000","last_peered":"2024-05-09T08:02:06.198154+0000","last_clean":"2024-05-09T08:02:06.198154+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T08:02:06.198154+0000","last_undegraded":"2024-05-09T08:02:06.198154+0000","last_fullsized":"2024-05-09T08:02:06.198154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'587","reported_seq":606,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202093+0000","last_change":"2024-05-09T07:54:37.104600+0000","last_active":"2024-05-09T08:02:06.202093+0000","last_peered":"2024-05-09T08:02:06.202093+0000","last_clean":"2024-05-09T08:02:06.202093+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T08:02:06.202093+0000","last_undegraded":"2024-05-09T08:02:06.202093+0000","last_fullsized":"2024-05-09T08:02:06.202093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":3262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'613","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182772+0000","last_change":"2024-05-09T07:54:37.104101+0000","last_active":"2024-05-09T08:02:06.182772+0000","last_peered":"2024-05-09T08:02:06.182772+0000","last_clean":"2024-05-09T08:02:06.182772+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T08:02:06.182772+0000","last_undegraded":"2024-05-09T08:02:06.182772+0000","last_fullsized":"2024-05-09T08:02:06.182772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'586","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199162+0000","last_change":"2024-05-09T07:54:37.109462+0000","last_active":"2024-05-09T08:02:06.199162+0000","last_peered":"2024-05-09T08:02:06.199162+0000","last_clean":"2024-05-09T08:02:06.199162+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T08:02:06.199162+0000","last_undegraded":"2024-05-09T08:02:06.199162+0000","last_fullsized":"2024-05-09T08:02:06.199162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":3420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'619","reported_seq":638,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182552+0000","last_change":"2024-05-09T07:54:37.114222+0000","last_active":"2024-05-09T08:02:06.182552+0000","last_peered":"2024-05-09T08:02:06.182552+0000","last_clean":"2024-05-09T08:02:06.182552+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T08:02:06.182552+0000","last_undegraded":"2024-05-09T08:02:06.182552+0000","last_fullsized":"2024-05-09T08:02:06.182552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'582","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202534+0000","last_change":"2024-05-09T07:54:37.110852+0000","last_active":"2024-05-09T08:02:06.202534+0000","last_peered":"2024-05-09T08:02:06.202534+0000","last_clean":"2024-05-09T08:02:06.202534+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T08:02:06.202534+0000","last_undegraded":"2024-05-09T08:02:06.202534+0000","last_fullsized":"2024-05-09T08:02:06.202534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":3532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'626","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197188+0000","last_change":"2024-05-09T07:54:37.106997+0000","last_active":"2024-05-09T08:02:06.197188+0000","last_peered":"2024-05-09T08:02:06.197188+0000","last_clean":"2024-05-09T08:02:06.197188+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T08:02:06.197188+0000","last_undegraded":"2024-05-09T08:02:06.197188+0000","last_fullsized":"2024-05-09T08:02:06.197188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":762,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'591","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.181461+0000","last_change":"2024-05-09T07:54:37.112111+0000","last_active":"2024-05-09T08:02:06.181461+0000","last_peered":"2024-05-09T08:02:06.181461+0000","last_clean":"2024-05-09T08:02:06.181461+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T08:02:06.181461+0000","last_undegraded":"2024-05-09T08:02:06.181461+0000","last_fullsized":"2024-05-09T08:02:06.181461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":3173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'551","reported_seq":570,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179585+0000","last_change":"2024-05-09T07:54:37.111412+0000","last_active":"2024-05-09T08:02:06.179585+0000","last_peered":"2024-05-09T08:02:06.179585+0000","last_clean":"2024-05-09T08:02:06.179585+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T08:02:06.179585+0000","last_undegraded":"2024-05-09T08:02:06.179585+0000","last_fullsized":"2024-05-09T08:02:06.179585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'545","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179793+0000","last_change":"2024-05-09T07:54:37.103229+0000","last_active":"2024-05-09T08:02:06.179793+0000","last_peered":"2024-05-09T08:02:06.179793+0000","last_clean":"2024-05-09T08:02:06.179793+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T08:02:06.179793+0000","last_undegraded":"2024-05-09T08:02:06.179793+0000","last_fullsized":"2024-05-09T08:02:06.179793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'584","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202129+0000","last_change":"2024-05-09T07:54:37.104238+0000","last_active":"2024-05-09T08:02:06.202129+0000","last_peered":"2024-05-09T08:02:06.202129+0000","last_clean":"2024-05-09T08:02:06.202129+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T08:02:06.202129+0000","last_undegraded":"2024-05-09T08:02:06.202129+0000","last_fullsized":"2024-05-09T08:02:06.202129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":3698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'626","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.203263+0000","last_change":"2024-05-09T07:54:37.105958+0000","last_active":"2024-05-09T08:02:06.203263+0000","last_peered":"2024-05-09T08:02:06.203263+0000","last_clean":"2024-05-09T08:02:06.203263+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T08:02:06.203263+0000","last_undegraded":"2024-05-09T08:02:06.203263+0000","last_fullsized":"2024-05-09T08:02:06.203263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:38.316625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":3967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'617","reported_seq":636,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196088+0000","last_change":"2024-05-09T07:54:37.090690+0000","last_active":"2024-05-09T08:02:06.196088+0000","last_peered":"2024-05-09T08:02:06.196088+0000","last_clean":"2024-05-09T08:02:06.196088+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T08:02:06.196088+0000","last_undegraded":"2024-05-09T08:02:06.196088+0000","last_fullsized":"2024-05-09T08:02:06.196088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":3825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'651","reported_seq":670,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197138+0000","last_change":"2024-05-09T07:54:37.110834+0000","last_active":"2024-05-09T08:02:06.197138+0000","last_peered":"2024-05-09T08:02:06.197138+0000","last_clean":"2024-05-09T08:02:06.197138+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T08:02:06.197138+0000","last_undegraded":"2024-05-09T08:02:06.197138+0000","last_fullsized":"2024-05-09T08:02:06.197138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'630","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185714+0000","last_change":"2024-05-09T07:54:37.099545+0000","last_active":"2024-05-09T08:02:06.185714+0000","last_peered":"2024-05-09T08:02:06.185714+0000","last_clean":"2024-05-09T08:02:06.185714+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T08:02:06.185714+0000","last_undegraded":"2024-05-09T08:02:06.185714+0000","last_fullsized":"2024-05-09T08:02:06.185714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":3592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'592","reported_seq":611,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184552+0000","last_change":"2024-05-09T07:54:37.105054+0000","last_active":"2024-05-09T08:02:06.184552+0000","last_peered":"2024-05-09T08:02:06.184552+0000","last_clean":"2024-05-09T08:02:06.184552+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T08:02:06.184552+0000","last_undegraded":"2024-05-09T08:02:06.184552+0000","last_fullsized":"2024-05-09T08:02:06.184552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'619","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196667+0000","last_change":"2024-05-09T07:55:18.561520+0000","last_active":"2024-05-09T08:02:06.196667+0000","last_peered":"2024-05-09T08:02:06.196667+0000","last_clean":"2024-05-09T08:02:06.196667+0000","last_became_active":"2024-05-09T07:55:18.561115+0000","last_became_peered":"2024-05-09T07:55:18.561115+0000","last_unstale":"2024-05-09T08:02:06.196667+0000","last_undegraded":"2024-05-09T08:02:06.196667+0000","last_fullsized":"2024-05-09T08:02:06.196667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:48.961063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"23'657","reported_seq":676,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.178687+0000","last_change":"2024-05-09T07:54:37.110846+0000","last_active":"2024-05-09T08:02:06.178687+0000","last_peered":"2024-05-09T08:02:06.178687+0000","last_clean":"2024-05-09T08:02:06.178687+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T08:02:06.178687+0000","last_undegraded":"2024-05-09T08:02:06.178687+0000","last_fullsized":"2024-05-09T08:02:06.178687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'610","reported_seq":629,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.205481+0000","last_change":"2024-05-09T07:54:37.110392+0000","last_active":"2024-05-09T08:02:06.205481+0000","last_peered":"2024-05-09T08:02:06.205481+0000","last_clean":"2024-05-09T08:02:06.205481+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T08:02:06.205481+0000","last_undegraded":"2024-05-09T08:02:06.205481+0000","last_fullsized":"2024-05-09T08:02:06.205481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":3681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'647","reported_seq":666,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185643+0000","last_change":"2024-05-09T07:54:37.098797+0000","last_active":"2024-05-09T08:02:06.185643+0000","last_peered":"2024-05-09T08:02:06.185643+0000","last_clean":"2024-05-09T08:02:06.185643+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T08:02:06.185643+0000","last_undegraded":"2024-05-09T08:02:06.185643+0000","last_fullsized":"2024-05-09T08:02:06.185643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":798,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'606","reported_seq":625,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200517+0000","last_change":"2024-05-09T07:54:37.112262+0000","last_active":"2024-05-09T08:02:06.200517+0000","last_peered":"2024-05-09T08:02:06.200517+0000","last_clean":"2024-05-09T08:02:06.200517+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T08:02:06.200517+0000","last_undegraded":"2024-05-09T08:02:06.200517+0000","last_fullsized":"2024-05-09T08:02:06.200517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":3749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'666","reported_seq":685,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202404+0000","last_change":"2024-05-09T07:54:37.102723+0000","last_active":"2024-05-09T08:02:06.202404+0000","last_peered":"2024-05-09T08:02:06.202404+0000","last_clean":"2024-05-09T08:02:06.202404+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T08:02:06.202404+0000","last_undegraded":"2024-05-09T08:02:06.202404+0000","last_fullsized":"2024-05-09T08:02:06.202404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":3958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'636","reported_seq":655,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199477+0000","last_change":"2024-05-09T07:54:37.101021+0000","last_active":"2024-05-09T08:02:06.199477+0000","last_peered":"2024-05-09T08:02:06.199477+0000","last_clean":"2024-05-09T08:02:06.199477+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T08:02:06.199477+0000","last_undegraded":"2024-05-09T08:02:06.199477+0000","last_fullsized":"2024-05-09T08:02:06.199477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'718","reported_seq":737,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195868+0000","last_change":"2024-05-09T07:54:37.106515+0000","last_active":"2024-05-09T08:02:06.195868+0000","last_peered":"2024-05-09T08:02:06.195868+0000","last_clean":"2024-05-09T08:02:06.195868+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T08:02:06.195868+0000","last_undegraded":"2024-05-09T08:02:06.195868+0000","last_fullsized":"2024-05-09T08:02:06.195868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'618","reported_seq":637,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202609+0000","last_change":"2024-05-09T07:54:37.101475+0000","last_active":"2024-05-09T08:02:06.202609+0000","last_peered":"2024-05-09T08:02:06.202609+0000","last_clean":"2024-05-09T08:02:06.202609+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T08:02:06.202609+0000","last_undegraded":"2024-05-09T08:02:06.202609+0000","last_fullsized":"2024-05-09T08:02:06.202609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'588","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200874+0000","last_change":"2024-05-09T07:54:37.112908+0000","last_active":"2024-05-09T08:02:06.200874+0000","last_peered":"2024-05-09T08:02:06.200874+0000","last_clean":"2024-05-09T08:02:06.200874+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T08:02:06.200874+0000","last_undegraded":"2024-05-09T08:02:06.200874+0000","last_fullsized":"2024-05-09T08:02:06.200874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":3451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'618","reported_seq":637,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.204290+0000","last_change":"2024-05-09T07:54:37.109141+0000","last_active":"2024-05-09T08:02:06.204290+0000","last_peered":"2024-05-09T08:02:06.204290+0000","last_clean":"2024-05-09T08:02:06.204290+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T08:02:06.204290+0000","last_undegraded":"2024-05-09T08:02:06.204290+0000","last_fullsized":"2024-05-09T08:02:06.204290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'697","reported_seq":716,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194343+0000","last_change":"2024-05-09T07:54:37.103105+0000","last_active":"2024-05-09T08:02:06.194343+0000","last_peered":"2024-05-09T08:02:06.194343+0000","last_clean":"2024-05-09T08:02:06.194343+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T08:02:06.194343+0000","last_undegraded":"2024-05-09T08:02:06.194343+0000","last_fullsized":"2024-05-09T08:02:06.194343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":843,"num_write_kb":3831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'687","reported_seq":706,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.173818+0000","last_change":"2024-05-09T07:54:37.109657+0000","last_active":"2024-05-09T08:02:06.173818+0000","last_peered":"2024-05-09T08:02:06.173818+0000","last_clean":"2024-05-09T08:02:06.173818+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T08:02:06.173818+0000","last_undegraded":"2024-05-09T08:02:06.173818+0000","last_fullsized":"2024-05-09T08:02:06.173818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'658","reported_seq":677,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198966+0000","last_change":"2024-05-09T07:54:37.111278+0000","last_active":"2024-05-09T08:02:06.198966+0000","last_peered":"2024-05-09T08:02:06.198966+0000","last_clean":"2024-05-09T08:02:06.198966+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T08:02:06.198966+0000","last_undegraded":"2024-05-09T08:02:06.198966+0000","last_fullsized":"2024-05-09T08:02:06.198966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'616","reported_seq":635,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.193871+0000","last_change":"2024-05-09T07:54:37.099560+0000","last_active":"2024-05-09T08:02:06.193871+0000","last_peered":"2024-05-09T08:02:06.193871+0000","last_clean":"2024-05-09T08:02:06.193871+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T08:02:06.193871+0000","last_undegraded":"2024-05-09T08:02:06.193871+0000","last_fullsized":"2024-05-09T08:02:06.193871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:30.636185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":3676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'432","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.221372+0000","last_change":"2024-05-09T07:54:36.105511+0000","last_active":"2024-05-09T08:01:57.221372+0000","last_peered":"2024-05-09T08:01:57.221372+0000","last_clean":"2024-05-09T08:01:57.221372+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T08:01:57.221372+0000","last_undegraded":"2024-05-09T08:01:57.221372+0000","last_fullsized":"2024-05-09T08:01:57.221372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":480,"num_write_kb":8805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'556","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.206383+0000","last_change":"2024-05-09T07:54:37.110626+0000","last_active":"2024-05-09T08:02:06.206383+0000","last_peered":"2024-05-09T08:02:06.206383+0000","last_clean":"2024-05-09T08:02:06.206383+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T08:02:06.206383+0000","last_undegraded":"2024-05-09T08:02:06.206383+0000","last_fullsized":"2024-05-09T08:02:06.206383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":668,"num_write_kb":3012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'950","reported_seq":971,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.242506+0000","last_change":"2024-05-09T07:54:36.099522+0000","last_active":"2024-05-09T08:01:57.242506+0000","last_peered":"2024-05-09T08:01:57.242506+0000","last_clean":"2024-05-09T08:01:57.242506+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T08:01:57.242506+0000","last_undegraded":"2024-05-09T08:01:57.242506+0000","last_fullsized":"2024-05-09T08:01:57.242506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1015,"num_write_kb":29485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'176","reported_seq":197,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.954166+0000","last_change":"2024-05-09T07:54:36.103352+0000","last_active":"2024-05-09T08:01:53.954166+0000","last_peered":"2024-05-09T08:01:53.954166+0000","last_clean":"2024-05-09T08:01:53.954166+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T08:01:53.954166+0000","last_undegraded":"2024-05-09T08:01:53.954166+0000","last_fullsized":"2024-05-09T08:01:53.954166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":217,"num_write_kb":8642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'671","reported_seq":690,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198240+0000","last_change":"2024-05-09T07:54:37.113565+0000","last_active":"2024-05-09T08:02:06.198240+0000","last_peered":"2024-05-09T08:02:06.198240+0000","last_clean":"2024-05-09T08:02:06.198240+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T08:02:06.198240+0000","last_undegraded":"2024-05-09T08:02:06.198240+0000","last_fullsized":"2024-05-09T08:02:06.198240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'710","reported_seq":731,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.210384+0000","last_change":"2024-05-09T07:54:36.091893+0000","last_active":"2024-05-09T08:01:54.210384+0000","last_peered":"2024-05-09T08:01:54.210384+0000","last_clean":"2024-05-09T08:01:54.210384+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T08:01:54.210384+0000","last_undegraded":"2024-05-09T08:01:54.210384+0000","last_fullsized":"2024-05-09T08:01:54.210384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":749,"num_write_kb":37565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'621","reported_seq":640,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202751+0000","last_change":"2024-05-09T07:54:37.106284+0000","last_active":"2024-05-09T08:02:06.202751+0000","last_peered":"2024-05-09T08:02:06.202751+0000","last_clean":"2024-05-09T08:02:06.202751+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T08:02:06.202751+0000","last_undegraded":"2024-05-09T08:02:06.202751+0000","last_fullsized":"2024-05-09T08:02:06.202751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":3585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'140","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.141597+0000","last_change":"2024-05-09T07:54:36.100068+0000","last_active":"2024-05-09T08:02:06.141597+0000","last_peered":"2024-05-09T08:02:06.141597+0000","last_clean":"2024-05-09T08:02:06.141597+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T08:02:06.141597+0000","last_undegraded":"2024-05-09T08:02:06.141597+0000","last_fullsized":"2024-05-09T08:02:06.141597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10381600,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":185,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'661","reported_seq":673,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.191831+0000","last_change":"2024-05-09T07:55:18.903031+0000","last_active":"2024-05-09T08:02:06.191831+0000","last_peered":"2024-05-09T08:02:06.191831+0000","last_clean":"2024-05-09T08:02:06.191831+0000","last_became_active":"2024-05-09T07:55:18.902706+0000","last_became_peered":"2024-05-09T07:55:18.902706+0000","last_unstale":"2024-05-09T08:02:06.191831+0000","last_undegraded":"2024-05-09T08:02:06.191831+0000","last_fullsized":"2024-05-09T08:02:06.191831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'443","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.201493+0000","last_change":"2024-05-09T07:54:36.100368+0000","last_active":"2024-05-09T08:01:56.201493+0000","last_peered":"2024-05-09T08:01:56.201493+0000","last_clean":"2024-05-09T08:01:56.201493+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T08:01:56.201493+0000","last_undegraded":"2024-05-09T08:01:56.201493+0000","last_fullsized":"2024-05-09T08:01:56.201493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":490,"num_write_kb":25148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'591","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199607+0000","last_change":"2024-05-09T07:54:37.107847+0000","last_active":"2024-05-09T08:02:06.199607+0000","last_peered":"2024-05-09T08:02:06.199607+0000","last_clean":"2024-05-09T08:02:06.199607+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T08:02:06.199607+0000","last_undegraded":"2024-05-09T08:02:06.199607+0000","last_fullsized":"2024-05-09T08:02:06.199607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'768","reported_seq":789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.276875+0000","last_change":"2024-05-09T07:54:36.101694+0000","last_active":"2024-05-09T08:01:57.276875+0000","last_peered":"2024-05-09T08:01:57.276875+0000","last_clean":"2024-05-09T08:01:57.276875+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T08:01:57.276875+0000","last_undegraded":"2024-05-09T08:01:57.276875+0000","last_fullsized":"2024-05-09T08:01:57.276875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":817,"num_write_kb":21310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'594","reported_seq":613,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195234+0000","last_change":"2024-05-09T07:54:37.098733+0000","last_active":"2024-05-09T08:02:06.195234+0000","last_peered":"2024-05-09T08:02:06.195234+0000","last_clean":"2024-05-09T08:02:06.195234+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T08:02:06.195234+0000","last_undegraded":"2024-05-09T08:02:06.195234+0000","last_fullsized":"2024-05-09T08:02:06.195234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:15.571989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'821","reported_seq":842,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.249921+0000","last_change":"2024-05-09T07:54:36.103096+0000","last_active":"2024-05-09T08:01:54.249921+0000","last_peered":"2024-05-09T08:01:54.249921+0000","last_clean":"2024-05-09T08:01:54.249921+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T08:01:54.249921+0000","last_undegraded":"2024-05-09T08:01:54.249921+0000","last_fullsized":"2024-05-09T08:01:54.249921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":851,"num_write_kb":25125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'612","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185887+0000","last_change":"2024-05-09T07:54:37.101875+0000","last_active":"2024-05-09T08:02:06.185887+0000","last_peered":"2024-05-09T08:02:06.185887+0000","last_clean":"2024-05-09T08:02:06.185887+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T08:02:06.185887+0000","last_undegraded":"2024-05-09T08:02:06.185887+0000","last_fullsized":"2024-05-09T08:02:06.185887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'702","reported_seq":723,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:49.153612+0000","last_change":"2024-05-09T07:54:36.090977+0000","last_active":"2024-05-09T08:01:49.153612+0000","last_peered":"2024-05-09T08:01:49.153612+0000","last_clean":"2024-05-09T08:01:49.153612+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T08:01:49.153612+0000","last_undegraded":"2024-05-09T08:01:49.153612+0000","last_fullsized":"2024-05-09T08:01:49.153612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:17.768144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":750,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'628","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200287+0000","last_change":"2024-05-09T07:54:37.105813+0000","last_active":"2024-05-09T08:02:06.200287+0000","last_peered":"2024-05-09T08:02:06.200287+0000","last_clean":"2024-05-09T08:02:06.200287+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T08:02:06.200287+0000","last_undegraded":"2024-05-09T08:02:06.200287+0000","last_fullsized":"2024-05-09T08:02:06.200287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:02.185354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'74","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.208101+0000","last_change":"2024-05-09T07:54:36.102510+0000","last_active":"2024-05-09T08:01:56.208101+0000","last_peered":"2024-05-09T08:01:56.208101+0000","last_clean":"2024-05-09T08:01:56.208101+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T08:01:56.208101+0000","last_undegraded":"2024-05-09T08:01:56.208101+0000","last_fullsized":"2024-05-09T08:01:56.208101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":148,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195420+0000","last_change":"2024-05-09T07:54:37.105015+0000","last_active":"2024-05-09T08:02:06.195420+0000","last_peered":"2024-05-09T08:02:06.195420+0000","last_clean":"2024-05-09T08:02:06.195420+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T08:02:06.195420+0000","last_undegraded":"2024-05-09T08:02:06.195420+0000","last_fullsized":"2024-05-09T08:02:06.195420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":3484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'101","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.227008+0000","last_change":"2024-05-09T07:54:36.103721+0000","last_active":"2024-05-09T08:01:57.227008+0000","last_peered":"2024-05-09T08:01:57.227008+0000","last_clean":"2024-05-09T08:01:57.227008+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T08:01:57.227008+0000","last_undegraded":"2024-05-09T08:01:57.227008+0000","last_fullsized":"2024-05-09T08:01:57.227008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":161,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'724","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.191153+0000","last_change":"2024-05-09T07:54:37.111215+0000","last_active":"2024-05-09T08:02:06.191153+0000","last_peered":"2024-05-09T08:02:06.191153+0000","last_clean":"2024-05-09T08:02:06.191153+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T08:02:06.191153+0000","last_undegraded":"2024-05-09T08:02:06.191153+0000","last_fullsized":"2024-05-09T08:02:06.191153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":3636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'183","reported_seq":204,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:52.188023+0000","last_change":"2024-05-09T07:54:36.098598+0000","last_active":"2024-05-09T08:01:52.188023+0000","last_peered":"2024-05-09T08:01:52.188023+0000","last_clean":"2024-05-09T08:01:52.188023+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T08:01:52.188023+0000","last_undegraded":"2024-05-09T08:01:52.188023+0000","last_fullsized":"2024-05-09T08:01:52.188023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":241,"num_write_kb":8581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'724","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.190619+0000","last_change":"2024-05-09T07:54:37.102764+0000","last_active":"2024-05-09T08:02:06.190619+0000","last_peered":"2024-05-09T08:02:06.190619+0000","last_clean":"2024-05-09T08:02:06.190619+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T08:02:06.190619+0000","last_undegraded":"2024-05-09T08:02:06.190619+0000","last_fullsized":"2024-05-09T08:02:06.190619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":3956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'289","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.201064+0000","last_change":"2024-05-09T07:54:36.092365+0000","last_active":"2024-05-09T08:01:56.201064+0000","last_peered":"2024-05-09T08:01:56.201064+0000","last_clean":"2024-05-09T08:01:56.201064+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T08:01:56.201064+0000","last_undegraded":"2024-05-09T08:01:56.201064+0000","last_fullsized":"2024-05-09T08:01:56.201064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":360,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'586","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192923+0000","last_change":"2024-05-09T07:54:37.100214+0000","last_active":"2024-05-09T08:02:06.192923+0000","last_peered":"2024-05-09T08:02:06.192923+0000","last_clean":"2024-05-09T08:02:06.192923+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T08:02:06.192923+0000","last_undegraded":"2024-05-09T08:02:06.192923+0000","last_fullsized":"2024-05-09T08:02:06.192923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":3597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'316","reported_seq":337,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.200234+0000","last_change":"2024-05-09T07:54:36.100004+0000","last_active":"2024-05-09T08:01:56.200234+0000","last_peered":"2024-05-09T08:01:56.200234+0000","last_clean":"2024-05-09T08:01:56.200234+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T08:01:56.200234+0000","last_undegraded":"2024-05-09T08:01:56.200234+0000","last_fullsized":"2024-05-09T08:01:56.200234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":351,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'580","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197234+0000","last_change":"2024-05-09T07:54:37.100879+0000","last_active":"2024-05-09T08:02:06.197234+0000","last_peered":"2024-05-09T08:02:06.197234+0000","last_clean":"2024-05-09T08:02:06.197234+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T08:02:06.197234+0000","last_undegraded":"2024-05-09T08:02:06.197234+0000","last_fullsized":"2024-05-09T08:02:06.197234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'462","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.295843+0000","last_change":"2024-05-09T07:54:36.099594+0000","last_active":"2024-05-09T08:01:55.295843+0000","last_peered":"2024-05-09T08:01:55.295843+0000","last_clean":"2024-05-09T08:01:55.295843+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T08:01:55.295843+0000","last_undegraded":"2024-05-09T08:01:55.295843+0000","last_fullsized":"2024-05-09T08:01:55.295843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":512,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'682","reported_seq":695,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182300+0000","last_change":"2024-05-09T07:55:18.559305+0000","last_active":"2024-05-09T08:02:06.182300+0000","last_peered":"2024-05-09T08:02:06.182300+0000","last_clean":"2024-05-09T08:02:06.182300+0000","last_became_active":"2024-05-09T07:55:18.558939+0000","last_became_peered":"2024-05-09T07:55:18.558939+0000","last_unstale":"2024-05-09T08:02:06.182300+0000","last_undegraded":"2024-05-09T08:02:06.182300+0000","last_fullsized":"2024-05-09T08:02:06.182300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"23'248","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.420616+0000","last_change":"2024-05-09T07:54:36.097398+0000","last_active":"2024-05-09T08:01:54.420616+0000","last_peered":"2024-05-09T08:01:54.420616+0000","last_clean":"2024-05-09T08:01:54.420616+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T08:01:54.420616+0000","last_undegraded":"2024-05-09T08:01:54.420616+0000","last_fullsized":"2024-05-09T08:01:54.420616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":299,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'588","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.187188+0000","last_change":"2024-05-09T07:54:37.108574+0000","last_active":"2024-05-09T08:02:06.187188+0000","last_peered":"2024-05-09T08:02:06.187188+0000","last_clean":"2024-05-09T08:02:06.187188+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T08:02:06.187188+0000","last_undegraded":"2024-05-09T08:02:06.187188+0000","last_fullsized":"2024-05-09T08:02:06.187188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":3417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T07:58:28.929423+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:58:28.929423+0000","last_peered":"2024-05-09T07:58:28.929423+0000","last_clean":"2024-05-09T07:58:28.929423+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:58:28.929423+0000","last_undegraded":"2024-05-09T07:58:28.929423+0000","last_fullsized":"2024-05-09T07:58:28.929423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'199","reported_seq":220,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.423265+0000","last_change":"2024-05-09T07:54:36.097635+0000","last_active":"2024-05-09T08:01:54.423265+0000","last_peered":"2024-05-09T08:01:54.423265+0000","last_clean":"2024-05-09T08:01:54.423265+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T08:01:54.423265+0000","last_undegraded":"2024-05-09T08:01:54.423265+0000","last_fullsized":"2024-05-09T08:01:54.423265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":237,"num_write_kb":12549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'566","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192763+0000","last_change":"2024-05-09T07:54:37.111470+0000","last_active":"2024-05-09T08:02:06.192763+0000","last_peered":"2024-05-09T08:02:06.192763+0000","last_clean":"2024-05-09T08:02:06.192763+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T08:02:06.192763+0000","last_undegraded":"2024-05-09T08:02:06.192763+0000","last_fullsized":"2024-05-09T08:02:06.192763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":3530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'754","reported_seq":775,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.206375+0000","last_change":"2024-05-09T07:54:36.107162+0000","last_active":"2024-05-09T08:01:56.206375+0000","last_peered":"2024-05-09T08:01:56.206375+0000","last_clean":"2024-05-09T08:01:56.206375+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T08:01:56.206375+0000","last_undegraded":"2024-05-09T08:01:56.206375+0000","last_fullsized":"2024-05-09T08:01:56.206375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":793,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184193+0000","last_change":"2024-05-09T07:54:37.102062+0000","last_active":"2024-05-09T08:02:06.184193+0000","last_peered":"2024-05-09T08:02:06.184193+0000","last_clean":"2024-05-09T08:02:06.184193+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T08:02:06.184193+0000","last_undegraded":"2024-05-09T08:02:06.184193+0000","last_fullsized":"2024-05-09T08:02:06.184193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:32.555846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":3702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'938","reported_seq":1645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:58.206696+0000","last_change":"2024-05-09T07:54:36.100227+0000","last_active":"2024-05-09T08:01:58.206696+0000","last_peered":"2024-05-09T08:01:58.206696+0000","last_clean":"2024-05-09T08:01:58.206696+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T08:01:58.206696+0000","last_undegraded":"2024-05-09T08:01:58.206696+0000","last_fullsized":"2024-05-09T08:01:58.206696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512596,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":706,"num_read_kb":1945,"num_write":995,"num_write_kb":14766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194027+0000","last_change":"2024-05-09T07:54:37.109167+0000","last_active":"2024-05-09T08:02:06.194027+0000","last_peered":"2024-05-09T08:02:06.194027+0000","last_clean":"2024-05-09T08:02:06.194027+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T08:02:06.194027+0000","last_undegraded":"2024-05-09T08:02:06.194027+0000","last_fullsized":"2024-05-09T08:02:06.194027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":3437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'650","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.250789+0000","last_change":"2024-05-09T07:54:36.100426+0000","last_active":"2024-05-09T08:01:54.250789+0000","last_peered":"2024-05-09T08:01:54.250789+0000","last_clean":"2024-05-09T08:01:54.250789+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T08:01:54.250789+0000","last_undegraded":"2024-05-09T08:01:54.250789+0000","last_fullsized":"2024-05-09T08:01:54.250789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":708,"num_write_kb":29261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'605","reported_seq":624,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194904+0000","last_change":"2024-05-09T07:54:37.108794+0000","last_active":"2024-05-09T08:02:06.194904+0000","last_peered":"2024-05-09T08:02:06.194904+0000","last_clean":"2024-05-09T08:02:06.194904+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T08:02:06.194904+0000","last_undegraded":"2024-05-09T08:02:06.194904+0000","last_fullsized":"2024-05-09T08:02:06.194904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:43.498827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'182","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.203877+0000","last_change":"2024-05-09T07:54:36.104155+0000","last_active":"2024-05-09T08:01:56.203877+0000","last_peered":"2024-05-09T08:01:56.203877+0000","last_clean":"2024-05-09T08:01:56.203877+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T08:01:56.203877+0000","last_undegraded":"2024-05-09T08:01:56.203877+0000","last_fullsized":"2024-05-09T08:01:56.203877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":263,"num_write_kb":8685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'644","reported_seq":663,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194002+0000","last_change":"2024-05-09T07:54:37.103562+0000","last_active":"2024-05-09T08:02:06.194002+0000","last_peered":"2024-05-09T08:02:06.194002+0000","last_clean":"2024-05-09T08:02:06.194002+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T08:02:06.194002+0000","last_undegraded":"2024-05-09T08:02:06.194002+0000","last_fullsized":"2024-05-09T08:02:06.194002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'488","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.207750+0000","last_change":"2024-05-09T07:54:36.106399+0000","last_active":"2024-05-09T08:01:56.207750+0000","last_peered":"2024-05-09T08:01:56.207750+0000","last_clean":"2024-05-09T08:01:56.207750+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T08:01:56.207750+0000","last_undegraded":"2024-05-09T08:01:56.207750+0000","last_fullsized":"2024-05-09T08:01:56.207750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":548,"num_write_kb":21106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'589","reported_seq":608,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196818+0000","last_change":"2024-05-09T07:54:37.105988+0000","last_active":"2024-05-09T08:02:06.196818+0000","last_peered":"2024-05-09T08:02:06.196818+0000","last_clean":"2024-05-09T08:02:06.196818+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T08:02:06.196818+0000","last_undegraded":"2024-05-09T08:02:06.196818+0000","last_fullsized":"2024-05-09T08:02:06.196818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":3737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'475","reported_seq":496,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:00.873819+0000","last_change":"2024-05-09T07:54:36.101002+0000","last_active":"2024-05-09T08:02:00.873819+0000","last_peered":"2024-05-09T08:02:00.873819+0000","last_clean":"2024-05-09T08:02:00.873819+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T08:02:00.873819+0000","last_undegraded":"2024-05-09T08:02:00.873819+0000","last_fullsized":"2024-05-09T08:02:00.873819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1199,"num_write_kb":9658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'541","reported_seq":560,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184733+0000","last_change":"2024-05-09T07:54:37.100183+0000","last_active":"2024-05-09T08:02:06.184733+0000","last_peered":"2024-05-09T08:02:06.184733+0000","last_clean":"2024-05-09T08:02:06.184733+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T08:02:06.184733+0000","last_undegraded":"2024-05-09T08:02:06.184733+0000","last_fullsized":"2024-05-09T08:02:06.184733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'250","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.209315+0000","last_change":"2024-05-09T07:54:36.105813+0000","last_active":"2024-05-09T08:01:56.209315+0000","last_peered":"2024-05-09T08:01:56.209315+0000","last_clean":"2024-05-09T08:01:56.209315+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T08:01:56.209315+0000","last_undegraded":"2024-05-09T08:01:56.209315+0000","last_fullsized":"2024-05-09T08:01:56.209315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":329,"num_write_kb":8747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'732","reported_seq":751,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.201728+0000","last_change":"2024-05-09T07:54:37.107782+0000","last_active":"2024-05-09T08:02:06.201728+0000","last_peered":"2024-05-09T08:02:06.201728+0000","last_clean":"2024-05-09T08:02:06.201728+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T08:02:06.201728+0000","last_undegraded":"2024-05-09T08:02:06.201728+0000","last_fullsized":"2024-05-09T08:02:06.201728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'189","reported_seq":210,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.297656+0000","last_change":"2024-05-09T07:54:36.106409+0000","last_active":"2024-05-09T08:01:55.297656+0000","last_peered":"2024-05-09T08:01:55.297656+0000","last_clean":"2024-05-09T08:01:55.297656+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T08:01:55.297656+0000","last_undegraded":"2024-05-09T08:01:55.297656+0000","last_fullsized":"2024-05-09T08:01:55.297656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":230,"num_write_kb":8511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'679","reported_seq":698,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179837+0000","last_change":"2024-05-09T07:54:37.104920+0000","last_active":"2024-05-09T08:02:06.179837+0000","last_peered":"2024-05-09T08:02:06.179837+0000","last_clean":"2024-05-09T08:02:06.179837+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T08:02:06.179837+0000","last_undegraded":"2024-05-09T08:02:06.179837+0000","last_fullsized":"2024-05-09T08:02:06.179837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":3995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'230","reported_seq":251,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:52.209441+0000","last_change":"2024-05-09T07:54:36.105662+0000","last_active":"2024-05-09T08:01:52.209441+0000","last_peered":"2024-05-09T08:01:52.209441+0000","last_clean":"2024-05-09T08:01:52.209441+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T08:01:52.209441+0000","last_undegraded":"2024-05-09T08:01:52.209441+0000","last_fullsized":"2024-05-09T08:01:52.209441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":261,"num_write_kb":12547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'635","reported_seq":654,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200088+0000","last_change":"2024-05-09T07:54:37.103640+0000","last_active":"2024-05-09T08:02:06.200088+0000","last_peered":"2024-05-09T08:02:06.200088+0000","last_clean":"2024-05-09T08:02:06.200088+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T08:02:06.200088+0000","last_undegraded":"2024-05-09T08:02:06.200088+0000","last_fullsized":"2024-05-09T08:02:06.200088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'493","reported_seq":514,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.222839+0000","last_change":"2024-05-09T07:54:36.102636+0000","last_active":"2024-05-09T08:01:57.222839+0000","last_peered":"2024-05-09T08:01:57.222839+0000","last_clean":"2024-05-09T08:01:57.222839+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T08:01:57.222839+0000","last_undegraded":"2024-05-09T08:01:57.222839+0000","last_fullsized":"2024-05-09T08:01:57.222839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":567,"num_write_kb":25391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'646","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.201248+0000","last_change":"2024-05-09T07:55:18.902612+0000","last_active":"2024-05-09T08:02:06.201248+0000","last_peered":"2024-05-09T08:02:06.201248+0000","last_clean":"2024-05-09T08:02:06.201248+0000","last_became_active":"2024-05-09T07:55:18.902275+0000","last_became_peered":"2024-05-09T07:55:18.902275+0000","last_unstale":"2024-05-09T08:02:06.201248+0000","last_undegraded":"2024-05-09T08:02:06.201248+0000","last_fullsized":"2024-05-09T08:02:06.201248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:54.608551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":3818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"23'887","reported_seq":908,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:50.185785+0000","last_change":"2024-05-09T07:54:36.104367+0000","last_active":"2024-05-09T08:01:50.185785+0000","last_peered":"2024-05-09T08:01:50.185785+0000","last_clean":"2024-05-09T08:01:50.185785+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T08:01:50.185785+0000","last_undegraded":"2024-05-09T08:01:50.185785+0000","last_fullsized":"2024-05-09T08:01:50.185785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":934,"num_write_kb":29264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'642","reported_seq":661,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.180045+0000","last_change":"2024-05-09T07:54:37.111038+0000","last_active":"2024-05-09T08:02:06.180045+0000","last_peered":"2024-05-09T08:02:06.180045+0000","last_clean":"2024-05-09T08:02:06.180045+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T08:02:06.180045+0000","last_undegraded":"2024-05-09T08:02:06.180045+0000","last_fullsized":"2024-05-09T08:02:06.180045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":3781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'597","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.178625+0000","last_change":"2024-05-09T07:55:18.558479+0000","last_active":"2024-05-09T08:02:06.178625+0000","last_peered":"2024-05-09T08:02:06.178625+0000","last_clean":"2024-05-09T08:02:06.178625+0000","last_became_active":"2024-05-09T07:55:18.558037+0000","last_became_peered":"2024-05-09T07:55:18.558037+0000","last_unstale":"2024-05-09T08:02:06.178625+0000","last_undegraded":"2024-05-09T08:02:06.178625+0000","last_fullsized":"2024-05-09T08:02:06.178625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'190","reported_seq":211,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.240539+0000","last_change":"2024-05-09T07:54:36.105726+0000","last_active":"2024-05-09T08:01:57.240539+0000","last_peered":"2024-05-09T08:01:57.240539+0000","last_clean":"2024-05-09T08:01:57.240539+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T08:01:57.240539+0000","last_undegraded":"2024-05-09T08:01:57.240539+0000","last_fullsized":"2024-05-09T08:01:57.240539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":262,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'590","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.172605+0000","last_change":"2024-05-09T07:54:37.092061+0000","last_active":"2024-05-09T08:02:06.172605+0000","last_peered":"2024-05-09T08:02:06.172605+0000","last_clean":"2024-05-09T08:02:06.172605+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T08:02:06.172605+0000","last_undegraded":"2024-05-09T08:02:06.172605+0000","last_fullsized":"2024-05-09T08:02:06.172605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1115","reported_seq":1136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.157658+0000","last_change":"2024-05-09T07:54:36.106635+0000","last_active":"2024-05-09T08:01:53.157658+0000","last_peered":"2024-05-09T08:01:53.157658+0000","last_clean":"2024-05-09T08:01:53.157658+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T08:01:53.157658+0000","last_undegraded":"2024-05-09T08:01:53.157658+0000","last_fullsized":"2024-05-09T08:01:53.157658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1161,"num_write_kb":29324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'532","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199819+0000","last_change":"2024-05-09T07:54:37.108470+0000","last_active":"2024-05-09T08:02:06.199819+0000","last_peered":"2024-05-09T08:02:06.199819+0000","last_clean":"2024-05-09T08:02:06.199819+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T08:02:06.199819+0000","last_undegraded":"2024-05-09T08:02:06.199819+0000","last_fullsized":"2024-05-09T08:02:06.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":3333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'708","reported_seq":729,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.297864+0000","last_change":"2024-05-09T07:54:36.102502+0000","last_active":"2024-05-09T08:01:55.297864+0000","last_peered":"2024-05-09T08:01:55.297864+0000","last_clean":"2024-05-09T08:01:55.297864+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T08:01:55.297864+0000","last_undegraded":"2024-05-09T08:01:55.297864+0000","last_fullsized":"2024-05-09T08:01:55.297864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":745,"num_write_kb":29116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'614","reported_seq":633,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194093+0000","last_change":"2024-05-09T07:54:37.104598+0000","last_active":"2024-05-09T08:02:06.194093+0000","last_peered":"2024-05-09T08:02:06.194093+0000","last_clean":"2024-05-09T08:02:06.194093+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T08:02:06.194093+0000","last_undegraded":"2024-05-09T08:02:06.194093+0000","last_fullsized":"2024-05-09T08:02:06.194093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'491","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.157976+0000","last_change":"2024-05-09T07:54:36.101744+0000","last_active":"2024-05-09T08:01:53.157976+0000","last_peered":"2024-05-09T08:01:53.157976+0000","last_clean":"2024-05-09T08:01:53.157976+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T08:01:53.157976+0000","last_undegraded":"2024-05-09T08:01:53.157976+0000","last_fullsized":"2024-05-09T08:01:53.157976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":559,"num_write_kb":8798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48848,"num_write_kb":235793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39700,"ondisk_log_size":39700,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":150307698,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1306,"num_read_kb":1945,"num_write":17417,"num_write_kb":525877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":300679168,"data_stored":300615396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15054,"ondisk_log_size":15054,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542241,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102712,"kb_used_data":53488,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94269128,"statfs":{"total":96636764160,"available":96531587072,"internally_reserved":0,"allocated":54771712,"data_stored":54613426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542241,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":21304,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":21815296,"data_stored":21649840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100920,"kb_used_data":29488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270920,"statfs":{"total":96636764160,"available":96533422080,"internally_reserved":0,"allocated":30195712,"data_stored":30038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122772,"kb_used_data":47244,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94249068,"statfs":{"total":96636764160,"available":96511045632,"internally_reserved":0,"allocated":48377856,"data_stored":48218322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574944,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108752,"kb_used_data":59528,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94263088,"statfs":{"total":96636764160,"available":96525402112,"internally_reserved":0,"allocated":60956672,"data_stored":60800652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116668,"kb_used_data":45300,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94255172,"statfs":{"total":96636764160,"available":96517296128,"internally_reserved":0,"allocated":46387200,"data_stored":46224784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101824,"kb_used_data":26296,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94270016,"statfs":{"total":96636764160,"available":96532496384,"internally_reserved":0,"allocated":26927104,"data_stored":26766406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71544,"kb_used_data":14000,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300296,"statfs":{"total":96636764160,"available":96563503104,"internally_reserved":0,"allocated":14336000,"data_stored":14182822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":54534144,"data_stored":54526112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14098432,"data_stored":14095508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26689536,"data_stored":26679092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":60719104,"data_stored":60713338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48140288,"data_stored":48131008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T08:02:13.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.892+0000 7f6f257ee640 1 Processor -- start 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.892+0000 7f6f257ee640 1 -- start start 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.892+0000 7f6f257ee640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f200b55c0 0x7f6f200b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.892+0000 7f6f257ee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f200b4e70 0x7f6f200b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f257ee640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f200b59a0 con 0x7f6f200b62d0 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f257ee640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f6f200b49e0 con 0x7f6f200b55c0 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f257ee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6f200b36d0 con 0x7f6f200b4e70 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f1effd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f200b55c0 0x7f6f200b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f1effd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6f200b55c0 0x7f6f200b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47042/0 (socket says 172.21.15.87:47042) 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f1effd640 1 -- 172.21.15.87:0/3633258437 learned_addr learned my addr 172.21.15.87:0/3633258437 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:13.912 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f1effd640 1 -- 172.21.15.87:0/3633258437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f200b4e70 msgr2=0x7f6f200b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f1effd640 1 --2- 172.21.15.87:0/3633258437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f200b4e70 0x7f6f200b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f1effd640 1 -- 172.21.15.87:0/3633258437 >> v1:172.21.15.110:6789/0 conn(0x7f6f200b62d0 legacy=0x7f6f20147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.893+0000 7f6f1effd640 1 -- 172.21.15.87:0/3633258437 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f200b4670 con 0x7f6f200b55c0 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f1effd640 1 --2- 172.21.15.87:0/3633258437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 0x7f6f200b3b20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009870 tx=0x7f6f1002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a768fb969d1975ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f1e7fc640 1 -- 172.21.15.87:0/3633258437 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10037070 con 0x7f6f200b55c0 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f1e7fc640 1 -- 172.21.15.87:0/3633258437 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1002ae10 con 0x7f6f200b55c0 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f1e7fc640 1 -- 172.21.15.87:0/3633258437 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10032660 con 0x7f6f200b55c0 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f257ee640 1 -- 172.21.15.87:0/3633258437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 msgr2=0x7f6f200b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f257ee640 1 --2- 172.21.15.87:0/3633258437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 0x7f6f200b3b20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009870 tx=0x7f6f1002a100 comp rx=0 tx=0).stop 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f257ee640 1 -- 172.21.15.87:0/3633258437 shutdown_connections 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f257ee640 1 --2- 172.21.15.87:0/3633258437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f200b4e70 0x7f6f200b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f257ee640 1 --2- 172.21.15.87:0/3633258437 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 0x7f6f200b3b20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f257ee640 1 -- 172.21.15.87:0/3633258437 >> 172.21.15.87:0/3633258437 conn(0x7f6f20067900 msgr2=0x7f6f200bd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f257ee640 1 -- 172.21.15.87:0/3633258437 shutdown_connections 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.894+0000 7f6f257ee640 1 -- 172.21.15.87:0/3633258437 wait complete. 2024-05-09T08:02:13.913 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.895+0000 7f6f257ee640 1 Processor -- start 2024-05-09T08:02:13.914 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.895+0000 7f6f257ee640 1 -- start start 2024-05-09T08:02:13.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f257ee640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f200b4e70 0x7f6f2014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f257ee640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 0x7f6f20142830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f257ee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f200b62d0 0x7f6f20142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f257ee640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201522d0 con 0x7f6f200b55c0 2024-05-09T08:02:13.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f257ee640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6f200b32a0 con 0x7f6f200b62d0 2024-05-09T08:02:13.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f257ee640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6f20152450 con 0x7f6f200b4e70 2024-05-09T08:02:13.916 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f17fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 0x7f6f20142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f17fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 0x7f6f20142830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47050/0 (socket says 172.21.15.87:47050) 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f17fff640 1 -- 172.21.15.87:0/3951249593 learned_addr learned my addr 172.21.15.87:0/3951249593 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f1f7fe640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f200b62d0 0x7f6f20142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f1effd640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f200b4e70 0x7f6f2014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f17fff640 1 -- 172.21.15.87:0/3951249593 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f200b4e70 msgr2=0x7f6f2014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f17fff640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f200b4e70 0x7f6f2014ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f17fff640 1 -- 172.21.15.87:0/3951249593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f200b62d0 msgr2=0x7f6f20142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f17fff640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f200b62d0 0x7f6f20142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f17fff640 1 -- 172.21.15.87:0/3951249593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2013f300 con 0x7f6f200b55c0 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f1f7fe640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f200b62d0 0x7f6f20142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.896+0000 7f6f17fff640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 0x7f6f20142830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800b3f0 tx=0x7f6f0800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.897+0000 7f6f177fe640 1 -- 172.21.15.87:0/3951249593 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08015020 con 0x7f6f200b55c0 2024-05-09T08:02:13.917 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.897+0000 7f6f177fe640 1 -- 172.21.15.87:0/3951249593 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f08011830 con 0x7f6f200b55c0 2024-05-09T08:02:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.897+0000 7f6f177fe640 1 -- 172.21.15.87:0/3951249593 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08011c20 con 0x7f6f200b55c0 2024-05-09T08:02:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.897+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f20144dc0 con 0x7f6f200b55c0 2024-05-09T08:02:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.897+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2013f020 con 0x7f6f200b55c0 2024-05-09T08:02:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.898+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f201452e0 con 0x7f6f200b55c0 2024-05-09T08:02:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.898+0000 7f6f177fe640 1 -- 172.21.15.87:0/3951249593 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f08018020 con 0x7f6f200b55c0 2024-05-09T08:02:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.899+0000 7f6f177fe640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6f0006be30 0x7f6f0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.899+0000 7f6f177fe640 1 -- 172.21.15.87:0/3951249593 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f6f0808add0 con 0x7f6f200b55c0 2024-05-09T08:02:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.899+0000 7f6f1effd640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6f0006be30 0x7f6f0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:13.918 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.899+0000 7f6f1effd640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6f0006be30 0x7f6f0006e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f10034000 tx=0x7f6f1002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:13.919 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:13.903+0000 7f6f177fe640 1 -- 172.21.15.87:0/3951249593 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f6f0801f020 con 0x7f6f200b55c0 2024-05-09T08:02:14.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.079+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f200691f0 con 0x7f6f200b55c0 2024-05-09T08:02:14.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.081+0000 7f6f177fe640 1 -- 172.21.15.87:0/3951249593 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16820 (secure 0 0 0) 0x7f6f0808c090 con 0x7f6f200b55c0 2024-05-09T08:02:14.097 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:14.098 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:55:18.551072+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.082+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6f0006be30 msgr2=0x7f6f0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6f0006be30 0x7f6f0006e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f10034000 tx=0x7f6f1002e000 comp rx=0 tx=0).stop 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 msgr2=0x7f6f20142830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 0x7f6f20142830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800b3f0 tx=0x7f6f0800b8b0 comp rx=0 tx=0).stop 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 shutdown_connections 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6f0006be30 0x7f6f0006e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f200b62d0 0x7f6f20142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6f200b55c0 0x7f6f20142830 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 --2- 172.21.15.87:0/3951249593 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f200b4e70 0x7f6f2014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 >> 172.21.15.87:0/3951249593 conn(0x7f6f20067900 msgr2=0x7f6f2013d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 shutdown_connections 2024-05-09T08:02:14.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:14.083+0000 7f6f257ee640 1 -- 172.21.15.87:0/3951249593 wait complete. 2024-05-09T08:02:15.112 INFO:tasks.ceph:Scrubbing osd.0 2024-05-09T08:02:15.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-09T08:02:15.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.211+0000 7f28651b0640 1 Processor -- start 2024-05-09T08:02:15.227 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.211+0000 7f28651b0640 1 -- start start 2024-05-09T08:02:15.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.211+0000 7f28651b0640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28600af900 0x7f28600b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.211+0000 7f28651b0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28600af1b0 0x7f28600b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f28651b0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600b4210 0x7f28600b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f28651b0640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f28600b3d80 con 0x7f28600af900 2024-05-09T08:02:15.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f28651b0640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f28600b0ed0 con 0x7f28600af1b0 2024-05-09T08:02:15.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f28651b0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f28600b3770 con 0x7f28600b4210 2024-05-09T08:02:15.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285ed9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28600af900 0x7f28600b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285ed9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f28600af900 0x7f28600b28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47056/0 (socket says 172.21.15.87:47056) 2024-05-09T08:02:15.230 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285ed9d640 1 -- 172.21.15.87:0/4149731527 learned_addr learned my addr 172.21.15.87:0/4149731527 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285659c640 1 --2- 172.21.15.87:0/4149731527 >> v2:172.21.15.110:3300/0 conn(0x7f28600af1b0 0x7f28600b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285f59e640 1 --2- 172.21.15.87:0/4149731527 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600b4210 0x7f28600b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285ed9d640 1 -- 172.21.15.87:0/4149731527 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600b4210 msgr2=0x7f28600b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285ed9d640 1 --2- 172.21.15.87:0/4149731527 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600b4210 0x7f28600b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285ed9d640 1 -- 172.21.15.87:0/4149731527 >> v2:172.21.15.110:3300/0 conn(0x7f28600af1b0 msgr2=0x7f28600b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285ed9d640 1 --2- 172.21.15.87:0/4149731527 >> v2:172.21.15.110:3300/0 conn(0x7f28600af1b0 0x7f28600b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285ed9d640 1 -- 172.21.15.87:0/4149731527 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28600b5530 con 0x7f28600af900 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285659c640 1 --2- 172.21.15.87:0/4149731527 >> v2:172.21.15.110:3300/0 conn(0x7f28600af1b0 0x7f28600b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.212+0000 7f285f59e640 1 --2- 172.21.15.87:0/4149731527 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600b4210 0x7f28600b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f285ed9d640 1 --2- 172.21.15.87:0/4149731527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600af900 0x7f28600b28e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f28600b04e0 tx=0x7f285002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231ca43bce529303 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f285e59c640 1 -- 172.21.15.87:0/4149731527 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850037070 con 0x7f28600af900 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f285e59c640 1 -- 172.21.15.87:0/4149731527 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285002ae00 con 0x7f28600af900 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f285e59c640 1 -- 172.21.15.87:0/4149731527 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850032660 con 0x7f28600af900 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f28651b0640 1 -- 172.21.15.87:0/4149731527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600af900 msgr2=0x7f28600b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.231 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f28651b0640 1 --2- 172.21.15.87:0/4149731527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600af900 0x7f28600b28e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f28600b04e0 tx=0x7f285002a0b0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f28651b0640 1 -- 172.21.15.87:0/4149731527 shutdown_connections 2024-05-09T08:02:15.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f28651b0640 1 --2- 172.21.15.87:0/4149731527 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600b4210 0x7f28600b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f28651b0640 1 --2- 172.21.15.87:0/4149731527 >> v2:172.21.15.110:3300/0 conn(0x7f28600af1b0 0x7f28600b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f28651b0640 1 --2- 172.21.15.87:0/4149731527 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600af900 0x7f28600b28e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f28651b0640 1 -- 172.21.15.87:0/4149731527 >> 172.21.15.87:0/4149731527 conn(0x7f286006c6a0 msgr2=0x7f286006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:15.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f28651b0640 1 -- 172.21.15.87:0/4149731527 shutdown_connections 2024-05-09T08:02:15.232 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.213+0000 7f28651b0640 1 -- 172.21.15.87:0/4149731527 wait complete. 2024-05-09T08:02:15.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.214+0000 7f28651b0640 1 Processor -- start 2024-05-09T08:02:15.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.214+0000 7f28651b0640 1 -- start start 2024-05-09T08:02:15.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f28651b0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28600af1b0 0x7f28600b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f28651b0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600af900 0x7f28601deac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.235 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f28651b0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600b4210 0x7f2860141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f28651b0640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f28600afce0 con 0x7f28600b4210 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f28651b0640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f28600b4b70 con 0x7f28600af1b0 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f28651b0640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f28600ade30 con 0x7f28600af900 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f285f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600b4210 0x7f2860141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f285f59e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600b4210 0x7f2860141ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47066/0 (socket says 172.21.15.87:47066) 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f285f59e640 1 -- 172.21.15.87:0/3037526211 learned_addr learned my addr 172.21.15.87:0/3037526211 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f285ed9d640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28600af1b0 0x7f28600b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f285659c640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600af900 0x7f28601deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f285f59e640 1 -- 172.21.15.87:0/3037526211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600af900 msgr2=0x7f28601deac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.215+0000 7f285f59e640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28600af900 0x7f28601deac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.216+0000 7f285f59e640 1 -- 172.21.15.87:0/3037526211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28600af1b0 msgr2=0x7f28600b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.216+0000 7f285f59e640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28600af1b0 0x7f28600b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.216+0000 7f285f59e640 1 -- 172.21.15.87:0/3037526211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28601cfbd0 con 0x7f28600b4210 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.216+0000 7f285f59e640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600b4210 0x7f2860141ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f285800cd50 tx=0x7f285800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.216+0000 7f2857fff640 1 -- 172.21.15.87:0/3037526211 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285800f680 con 0x7f28600b4210 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.216+0000 7f2857fff640 1 -- 172.21.15.87:0/3037526211 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285800f840 con 0x7f28600b4210 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.216+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28601de2c0 con 0x7f28600b4210 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.216+0000 7f2857fff640 1 -- 172.21.15.87:0/3037526211 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285800fc30 con 0x7f28600b4210 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.216+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28601427e0 con 0x7f28600b4210 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.217+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28601de6a0 con 0x7f28600b4210 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.217+0000 7f2857fff640 1 -- 172.21.15.87:0/3037526211 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28580213f0 con 0x7f28600b4210 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.218+0000 7f2857fff640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f284006be60 0x7f284006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.218+0000 7f2857fff640 1 -- 172.21.15.87:0/3037526211 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f285808baa0 con 0x7f28600b4210 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.218+0000 7f285ed9d640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f284006be60 0x7f284006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.218+0000 7f2857fff640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7f28400741e0 0x7f2840076680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.218+0000 7f2857fff640 1 -- 172.21.15.87:0/3037526211 --> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f285801ee80 con 0x7f28400741e0 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.218+0000 7f2857fff640 1 -- 172.21.15.87:0/3037526211 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f28580902c0 con 0x7f28600b4210 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.218+0000 7f285659c640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7f28400741e0 0x7f2840076680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.218+0000 7f285ed9d640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f284006be60 0x7f284006e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2850034000 tx=0x7f285002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.219+0000 7f285659c640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7f28400741e0 0x7f2840076680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.219+0000 7f2857fff640 1 -- 172.21.15.87:0/3037526211 <== osd.0 v2:172.21.15.87:6800/1946784247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f285801ee80 con 0x7f28400741e0 2024-05-09T08:02:15.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.232+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 --> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f28600691f0 con 0x7f28400741e0 2024-05-09T08:02:15.249 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.232+0000 7f2857fff640 1 -- 172.21.15.87:0/3037526211 <== osd.0 v2:172.21.15.87:6800/1946784247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f28600691f0 con 0x7f28400741e0 2024-05-09T08:02:15.249 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:15.249 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T08:02:15.249 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:15.250 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7f28400741e0 msgr2=0x7f2840076680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6800/1946784247,v1:172.21.15.87:6801/1946784247] conn(0x7f28400741e0 0x7f2840076680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f284006be60 msgr2=0x7f284006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f284006be60 0x7f284006e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2850034000 tx=0x7f285002e000 comp rx=0 tx=0).stop 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600b4210 msgr2=0x7f2860141ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 --2- 172.21.15.87:0/3037526211 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28600b4210 0x7f2860141ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f285800cd50 tx=0x7f285800a650 comp rx=0 tx=0).stop 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f285f59e640 1 -- 172.21.15.87:0/3037526211 reap_dead start 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 shutdown_connections 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 >> 172.21.15.87:0/3037526211 conn(0x7f286006c6a0 msgr2=0x7f28600b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 shutdown_connections 2024-05-09T08:02:15.251 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.233+0000 7f28651b0640 1 -- 172.21.15.87:0/3037526211 wait complete. 2024-05-09T08:02:15.260 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-09T08:02:15.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.345+0000 7f60e5570640 1 Processor -- start 2024-05-09T08:02:15.362 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.345+0000 7f60e5570640 1 -- start start 2024-05-09T08:02:15.363 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60e5570640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60e014afa0 0x7f60e0141510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60e5570640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60e00b0b10 0x7f60e0141a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60e5570640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014b380 0x7f60e00b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60e5570640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f60e00b6860 con 0x7f60e014afa0 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60e5570640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f60e00b1ab0 con 0x7f60e00b0b10 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60e5570640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f60e014b930 con 0x7f60e014b380 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60deffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60e014afa0 0x7f60e0141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60deffd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60e014afa0 0x7f60e0141510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47068/0 (socket says 172.21.15.87:47068) 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60deffd640 1 -- 172.21.15.87:0/1955367222 learned_addr learned my addr 172.21.15.87:0/1955367222 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60de7fc640 1 --2- 172.21.15.87:0/1955367222 >> v2:172.21.15.110:3300/0 conn(0x7f60e00b0b10 0x7f60e0141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60df7fe640 1 --2- 172.21.15.87:0/1955367222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014b380 0x7f60e00b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60deffd640 1 -- 172.21.15.87:0/1955367222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014b380 msgr2=0x7f60e00b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60deffd640 1 --2- 172.21.15.87:0/1955367222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014b380 0x7f60e00b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60deffd640 1 -- 172.21.15.87:0/1955367222 >> v2:172.21.15.110:3300/0 conn(0x7f60e00b0b10 msgr2=0x7f60e0141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60deffd640 1 --2- 172.21.15.87:0/1955367222 >> v2:172.21.15.110:3300/0 conn(0x7f60e00b0b10 0x7f60e0141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.364 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.346+0000 7f60deffd640 1 -- 172.21.15.87:0/1955367222 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e014bc10 con 0x7f60e014afa0 2024-05-09T08:02:15.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.347+0000 7f60deffd640 1 --2- 172.21.15.87:0/1955367222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e014afa0 0x7f60e0141510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60e00b5a50 tx=0x7f60d002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4da42ddf75bf6d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.347+0000 7f60ddffb640 1 -- 172.21.15.87:0/1955367222 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0037070 con 0x7f60e014afa0 2024-05-09T08:02:15.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.347+0000 7f60ddffb640 1 -- 172.21.15.87:0/1955367222 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60d0032440 con 0x7f60e014afa0 2024-05-09T08:02:15.365 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.347+0000 7f60ddffb640 1 -- 172.21.15.87:0/1955367222 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0032810 con 0x7f60e014afa0 2024-05-09T08:02:15.367 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.347+0000 7f60e5570640 1 -- 172.21.15.87:0/1955367222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e014afa0 msgr2=0x7f60e0141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.348+0000 7f60e5570640 1 --2- 172.21.15.87:0/1955367222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e014afa0 0x7f60e0141510 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f60e00b5a50 tx=0x7f60d002a140 comp rx=0 tx=0).stop 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.348+0000 7f60e5570640 1 -- 172.21.15.87:0/1955367222 shutdown_connections 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.348+0000 7f60e5570640 1 --2- 172.21.15.87:0/1955367222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014b380 0x7f60e00b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.348+0000 7f60e5570640 1 --2- 172.21.15.87:0/1955367222 >> v2:172.21.15.110:3300/0 conn(0x7f60e00b0b10 0x7f60e0141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.348+0000 7f60e5570640 1 --2- 172.21.15.87:0/1955367222 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e014afa0 0x7f60e0141510 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.348+0000 7f60e5570640 1 -- 172.21.15.87:0/1955367222 >> 172.21.15.87:0/1955367222 conn(0x7f60e00baf40 msgr2=0x7f60e00bb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.348+0000 7f60e5570640 1 -- 172.21.15.87:0/1955367222 shutdown_connections 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.348+0000 7f60e5570640 1 -- 172.21.15.87:0/1955367222 wait complete. 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60e5570640 1 Processor -- start 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60e5570640 1 -- start start 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60e5570640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e00b0b10 0x7f60e01dd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60e5570640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014afa0 0x7f60e00b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60e5570640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e014b380 0x7f60e013dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60e5570640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f60e00b7400 con 0x7f60e00b0b10 2024-05-09T08:02:15.368 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60e5570640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f60e00b7280 con 0x7f60e014b380 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60e5570640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f60e00b7580 con 0x7f60e014afa0 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60deffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e00b0b10 0x7f60e01dd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60deffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e00b0b10 0x7f60e01dd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47082/0 (socket says 172.21.15.87:47082) 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60deffd640 1 -- 172.21.15.87:0/3124239173 learned_addr learned my addr 172.21.15.87:0/3124239173 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60df7fe640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e014b380 0x7f60e013dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.349+0000 7f60de7fc640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014afa0 0x7f60e00b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60deffd640 1 -- 172.21.15.87:0/3124239173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014afa0 msgr2=0x7f60e00b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60deffd640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014afa0 0x7f60e00b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60deffd640 1 -- 172.21.15.87:0/3124239173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e014b380 msgr2=0x7f60e013dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60deffd640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e014b380 0x7f60e013dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60deffd640 1 -- 172.21.15.87:0/3124239173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e01dde10 con 0x7f60e00b0b10 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60deffd640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e00b0b10 0x7f60e01dd780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f60d002a180 tx=0x7f60d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60c77fe640 1 -- 172.21.15.87:0/3124239173 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0037040 con 0x7f60e00b0b10 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60c77fe640 1 -- 172.21.15.87:0/3124239173 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60d0042070 con 0x7f60e00b0b10 2024-05-09T08:02:15.369 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e01de0f0 con 0x7f60e00b0b10 2024-05-09T08:02:15.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60c77fe640 1 -- 172.21.15.87:0/3124239173 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0030880 con 0x7f60e00b0b10 2024-05-09T08:02:15.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.350+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e00b4570 con 0x7f60e00b0b10 2024-05-09T08:02:15.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.351+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e00691f0 con 0x7f60e00b0b10 2024-05-09T08:02:15.370 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.351+0000 7f60c77fe640 1 -- 172.21.15.87:0/3124239173 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60d0030a20 con 0x7f60e00b0b10 2024-05-09T08:02:15.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.352+0000 7f60c77fe640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f60cc06be60 0x7f60cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.352+0000 7f60c77fe640 1 -- 172.21.15.87:0/3124239173 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f60d00ab570 con 0x7f60e00b0b10 2024-05-09T08:02:15.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.352+0000 7f60de7fc640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f60cc06be60 0x7f60cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.371 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.352+0000 7f60de7fc640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f60cc06be60 0x7f60cc06e320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f60e00b52b0 tx=0x7f60d4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.372 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.356+0000 7f60c77fe640 1 -- 172.21.15.87:0/3124239173 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f60d00798d0 con 0x7f60e00b0b10 2024-05-09T08:02:15.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.529+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f60e006f6a0 con 0x7f60cc06be60 2024-05-09T08:02:15.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.529+0000 7f60c77fe640 1 -- 172.21.15.87:0/3124239173 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f60e006f6a0 con 0x7f60cc06be60 2024-05-09T08:02:15.546 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 0 to deep-scrub 2024-05-09T08:02:15.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f60cc06be60 msgr2=0x7f60cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f60cc06be60 0x7f60cc06e320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f60e00b52b0 tx=0x7f60d4009190 comp rx=0 tx=0).stop 2024-05-09T08:02:15.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e00b0b10 msgr2=0x7f60e01dd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e00b0b10 0x7f60e01dd780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f60d002a180 tx=0x7f60d00046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 shutdown_connections 2024-05-09T08:02:15.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f60cc06be60 0x7f60cc06e320 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e014afa0 0x7f60e00b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e014b380 0x7f60e013dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 --2- 172.21.15.87:0/3124239173 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60e00b0b10 0x7f60e01dd780 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 >> 172.21.15.87:0/3124239173 conn(0x7f60e00baf40 msgr2=0x7f60e009ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:15.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 shutdown_connections 2024-05-09T08:02:15.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.531+0000 7f60e5570640 1 -- 172.21.15.87:0/3124239173 wait complete. 2024-05-09T08:02:15.559 INFO:tasks.ceph:Scrubbing osd.1 2024-05-09T08:02:15.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-09T08:02:15.663 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.646+0000 7f855e330640 1 Processor -- start 2024-05-09T08:02:15.664 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.646+0000 7f855e330640 1 -- start start 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855e330640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85580b5e60 0x7f85580b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855e330640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f85580b2940 0x7f8558147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855e330640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85580b6240 con 0x7f85580b5330 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855e330640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f85580b0470 con 0x7f85580b2940 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855e330640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f85580b1580 con 0x7f85580b5e60 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855c8cd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f85580b2940 0x7f8558147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855c8cd640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f85580b2940 0x7f8558147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47084/0 (socket says 172.21.15.87:47084) 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855c8cd640 1 -- 172.21.15.87:0/4212013338 learned_addr learned my addr 172.21.15.87:0/4212013338 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f8557fff640 1 --2- 172.21.15.87:0/4212013338 >> v2:172.21.15.110:3300/0 conn(0x7f85580b5e60 0x7f85580b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855c8cd640 1 -- 172.21.15.87:0/4212013338 >> v2:172.21.15.110:3300/0 conn(0x7f85580b5e60 msgr2=0x7f85580b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855c8cd640 1 --2- 172.21.15.87:0/4212013338 >> v2:172.21.15.110:3300/0 conn(0x7f85580b5e60 0x7f85580b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.666 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855c8cd640 1 -- 172.21.15.87:0/4212013338 >> v1:172.21.15.110:6789/0 conn(0x7f85580b5330 legacy=0x7f85580b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.647+0000 7f855c8cd640 1 -- 172.21.15.87:0/4212013338 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85580b1860 con 0x7f85580b2940 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.648+0000 7f855c8cd640 1 --2- 172.21.15.87:0/4212013338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 0x7f8558147bd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f855806dc50 tx=0x7f855002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1106ad0956a5495 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.648+0000 7f85577fe640 1 -- 172.21.15.87:0/4212013338 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8550036070 con 0x7f85580b2940 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.648+0000 7f85577fe640 1 -- 172.21.15.87:0/4212013338 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8550031600 con 0x7f85580b2940 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.648+0000 7f85577fe640 1 -- 172.21.15.87:0/4212013338 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500319d0 con 0x7f85580b2940 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.649+0000 7f855e330640 1 -- 172.21.15.87:0/4212013338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 msgr2=0x7f8558147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.649+0000 7f855e330640 1 --2- 172.21.15.87:0/4212013338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 0x7f8558147bd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f855806dc50 tx=0x7f855002a6d0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.649+0000 7f855e330640 1 -- 172.21.15.87:0/4212013338 shutdown_connections 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.649+0000 7f855e330640 1 --2- 172.21.15.87:0/4212013338 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 0x7f8558147bd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.649+0000 7f855e330640 1 --2- 172.21.15.87:0/4212013338 >> v2:172.21.15.110:3300/0 conn(0x7f85580b5e60 0x7f85580b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.649+0000 7f855e330640 1 -- 172.21.15.87:0/4212013338 >> 172.21.15.87:0/4212013338 conn(0x7f855806c6a0 msgr2=0x7f855806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.649+0000 7f855e330640 1 -- 172.21.15.87:0/4212013338 shutdown_connections 2024-05-09T08:02:15.667 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.649+0000 7f855e330640 1 -- 172.21.15.87:0/4212013338 wait complete. 2024-05-09T08:02:15.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.650+0000 7f855e330640 1 Processor -- start 2024-05-09T08:02:15.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.650+0000 7f855e330640 1 -- start start 2024-05-09T08:02:15.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.650+0000 7f855e330640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 0x7f85580adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.650+0000 7f855e330640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85580b5330 0x7f8558141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f855e330640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b5e60 0x7f8558143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f855e330640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f85580afae0 con 0x7f85580b2940 2024-05-09T08:02:15.670 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f855e330640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f85580af960 con 0x7f85580b5e60 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f855e330640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8558148110 con 0x7f85580b5330 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f8557fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 0x7f85580adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f8557fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 0x7f85580adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47100/0 (socket says 172.21.15.87:47100) 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f8557fff640 1 -- 172.21.15.87:0/3947196819 learned_addr learned my addr 172.21.15.87:0/3947196819 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f855c8cd640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b5e60 0x7f8558143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f854ffff640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85580b5330 0x7f8558141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f8557fff640 1 -- 172.21.15.87:0/3947196819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85580b5330 msgr2=0x7f8558141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f8557fff640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85580b5330 0x7f8558141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f8557fff640 1 -- 172.21.15.87:0/3947196819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b5e60 msgr2=0x7f8558143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f8557fff640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85580b5e60 0x7f8558143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f8557fff640 1 -- 172.21.15.87:0/3947196819 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8558141310 con 0x7f85580b2940 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f8557fff640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 0x7f85580adff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f854800f9a0 tx=0x7f854800fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f85557fa640 1 -- 172.21.15.87:0/3947196819 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548007bd0 con 0x7f85580b2940 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f85557fa640 1 -- 172.21.15.87:0/3947196819 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8548007d90 con 0x7f85580b2940 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f85557fa640 1 -- 172.21.15.87:0/3947196819 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548011690 con 0x7f85580b2940 2024-05-09T08:02:15.671 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85581420e0 con 0x7f85580b2940 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.651+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8558140fe0 con 0x7f85580b2940 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.652+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f855809eea0 con 0x7f85580b2940 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.653+0000 7f85557fa640 1 -- 172.21.15.87:0/3947196819 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8548019020 con 0x7f85580b2940 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.653+0000 7f85557fa640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f853806be60 0x7f853806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.653+0000 7f854ffff640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f853806be60 0x7f853806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.653+0000 7f85557fa640 1 -- 172.21.15.87:0/3947196819 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f854808d100 con 0x7f85580b2940 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.653+0000 7f85557fa640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f85380741e0 0x7f8538076680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.653+0000 7f85557fa640 1 -- 172.21.15.87:0/3947196819 --> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8548015e50 con 0x7f85380741e0 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.653+0000 7f85557fa640 1 -- 172.21.15.87:0/3947196819 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f8548094050 con 0x7f85580b2940 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.653+0000 7f855c8cd640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f85380741e0 0x7f8538076680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.654+0000 7f854ffff640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f853806be60 0x7f853806e320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8558146720 tx=0x7f8540009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.672 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.654+0000 7f855c8cd640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f85380741e0 0x7f8538076680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.673 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.654+0000 7f85557fa640 1 -- 172.21.15.87:0/3947196819 <== osd.1 v2:172.21.15.87:6808/2730159651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8548015e50 con 0x7f85380741e0 2024-05-09T08:02:15.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.667+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 --> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f85580691f0 con 0x7f85380741e0 2024-05-09T08:02:15.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.667+0000 7f85557fa640 1 -- 172.21.15.87:0/3947196819 <== osd.1 v2:172.21.15.87:6808/2730159651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f85580691f0 con 0x7f85380741e0 2024-05-09T08:02:15.684 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:15.684 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T08:02:15.684 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:15.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f85380741e0 msgr2=0x7f8538076680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6808/2730159651,v1:172.21.15.87:6809/2730159651] conn(0x7f85380741e0 0x7f8538076680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.685 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f853806be60 msgr2=0x7f853806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f853806be60 0x7f853806e320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8558146720 tx=0x7f8540009040 comp rx=0 tx=0).stop 2024-05-09T08:02:15.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 msgr2=0x7f85580adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 --2- 172.21.15.87:0/3947196819 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f85580b2940 0x7f85580adff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f854800f9a0 tx=0x7f854800fe60 comp rx=0 tx=0).stop 2024-05-09T08:02:15.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855c8cd640 1 -- 172.21.15.87:0/3947196819 reap_dead start 2024-05-09T08:02:15.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 shutdown_connections 2024-05-09T08:02:15.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 >> 172.21.15.87:0/3947196819 conn(0x7f855806c6a0 msgr2=0x7f85580b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:15.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 shutdown_connections 2024-05-09T08:02:15.686 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.668+0000 7f855e330640 1 -- 172.21.15.87:0/3947196819 wait complete. 2024-05-09T08:02:15.695 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-09T08:02:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.780+0000 7f28b1d9e640 1 Processor -- start 2024-05-09T08:02:15.796 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.780+0000 7f28b1d9e640 1 -- start start 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.780+0000 7f28b1d9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac0b56c0 0x7f28ac06b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.780+0000 7f28b1d9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28ac14bbd0 0x7f28ac1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.780+0000 7f28b1d9e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28ac06ea50 con 0x7f28ac14b080 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.780+0000 7f28b1d9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f28ac0b5aa0 con 0x7f28ac14bbd0 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.780+0000 7f28b1d9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f28ac0b4850 con 0x7f28ac0b56c0 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28ab7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac0b56c0 0x7f28ac06b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28abfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28ac14bbd0 0x7f28ac1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28a3fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f28ac14b080 0x7f28ac14b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:52126/0 (socket says 172.21.15.87:52126) 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28a3fff640 1 -- 172.21.15.87:0/2183598666 learned_addr learned my addr 172.21.15.87:0/2183598666 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28aaffd640 1 -- 172.21.15.87:0/2183598666 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086008765 0 0) 0x7f28ac06ea50 con 0x7f28ac14b080 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28aaffd640 1 -- 172.21.15.87:0/2183598666 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2898003520 con 0x7f28ac14b080 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28ab7fe640 1 -- 172.21.15.87:0/2183598666 >> v2:172.21.15.110:3300/0 conn(0x7f28ac14bbd0 msgr2=0x7f28ac1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:15.799 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28ab7fe640 1 --2- 172.21.15.87:0/2183598666 >> v2:172.21.15.110:3300/0 conn(0x7f28ac14bbd0 0x7f28ac1525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28ab7fe640 1 -- 172.21.15.87:0/2183598666 >> v1:172.21.15.110:6789/0 conn(0x7f28ac14b080 legacy=0x7f28ac14b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28ab7fe640 1 -- 172.21.15.87:0/2183598666 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ac0af010 con 0x7f28ac0b56c0 2024-05-09T08:02:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.781+0000 7f28abfff640 1 --2- 172.21.15.87:0/2183598666 >> v2:172.21.15.110:3300/0 conn(0x7f28ac14bbd0 0x7f28ac1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:02:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.782+0000 7f28ab7fe640 1 --2- 172.21.15.87:0/2183598666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac0b56c0 0x7f28ac06b1f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f289c0097a0 tx=0x7f289c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=697e42489a6bf6e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.782+0000 7f28aaffd640 1 -- 172.21.15.87:0/2183598666 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c037070 con 0x7f28ac0b56c0 2024-05-09T08:02:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.782+0000 7f28aaffd640 1 -- 172.21.15.87:0/2183598666 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c02ae50 con 0x7f28ac0b56c0 2024-05-09T08:02:15.800 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.782+0000 7f28aaffd640 1 -- 172.21.15.87:0/2183598666 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c032640 con 0x7f28ac0b56c0 2024-05-09T08:02:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.783+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2183598666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac0b56c0 msgr2=0x7f28ac06b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.783+0000 7f28b1d9e640 1 --2- 172.21.15.87:0/2183598666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac0b56c0 0x7f28ac06b1f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f289c0097a0 tx=0x7f289c02a100 comp rx=0 tx=0).stop 2024-05-09T08:02:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.783+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2183598666 shutdown_connections 2024-05-09T08:02:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.783+0000 7f28b1d9e640 1 --2- 172.21.15.87:0/2183598666 >> v2:172.21.15.110:3300/0 conn(0x7f28ac14bbd0 0x7f28ac1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.783+0000 7f28b1d9e640 1 --2- 172.21.15.87:0/2183598666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac0b56c0 0x7f28ac06b1f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.783+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2183598666 >> 172.21.15.87:0/2183598666 conn(0x7f28ac0b6950 msgr2=0x7f28ac0b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.783+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2183598666 shutdown_connections 2024-05-09T08:02:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.783+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2183598666 wait complete. 2024-05-09T08:02:15.803 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28b1d9e640 1 Processor -- start 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28b1d9e640 1 -- start start 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28b1d9e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac0b56c0 0x7f28ac0ba630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28b1d9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28ac14b080 0x7f28ac1e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28b1d9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac14bbd0 0x7f28ac1e1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28b1d9e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac0afec0 con 0x7f28ac0b56c0 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28b1d9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac0b5000 con 0x7f28ac14b080 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28b1d9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f28ac0b03e0 con 0x7f28ac14bbd0 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac0b56c0 0x7f28ac0ba630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28ab7fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac0b56c0 0x7f28ac0ba630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47110/0 (socket says 172.21.15.87:47110) 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.784+0000 7f28ab7fe640 1 -- 172.21.15.87:0/2517596749 learned_addr learned my addr 172.21.15.87:0/2517596749 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28a3fff640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28ac14b080 0x7f28ac1e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28ab7fe640 1 -- 172.21.15.87:0/2517596749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac14bbd0 msgr2=0x7f28ac1e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28abfff640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac14bbd0 0x7f28ac1e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.804 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28ab7fe640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac14bbd0 0x7f28ac1e1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28ab7fe640 1 -- 172.21.15.87:0/2517596749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28ac14b080 msgr2=0x7f28ac1e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28ab7fe640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28ac14b080 0x7f28ac1e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28ab7fe640 1 -- 172.21.15.87:0/2517596749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ac1d2800 con 0x7f28ac0b56c0 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28a3fff640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28ac14b080 0x7f28ac1e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28ab7fe640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac0b56c0 0x7f28ac0ba630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f289c035040 tx=0x7f289c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28a8ff9640 1 -- 172.21.15.87:0/2517596749 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c037050 con 0x7f28ac0b56c0 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28a8ff9640 1 -- 172.21.15.87:0/2517596749 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c038040 con 0x7f28ac0b56c0 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ac148ca0 con 0x7f28ac0b56c0 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28a8ff9640 1 -- 172.21.15.87:0/2517596749 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c0044c0 con 0x7f28ac0b56c0 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.785+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ac1d1400 con 0x7f28ac0b56c0 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.786+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ac0691f0 con 0x7f28ac0b56c0 2024-05-09T08:02:15.805 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.786+0000 7f28a8ff9640 1 -- 172.21.15.87:0/2517596749 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f289c045020 con 0x7f28ac0b56c0 2024-05-09T08:02:15.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.787+0000 7f28a8ff9640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f288c06be30 0x7f288c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:15.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.787+0000 7f28a8ff9640 1 -- 172.21.15.87:0/2517596749 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f289c0ab000 con 0x7f28ac0b56c0 2024-05-09T08:02:15.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.787+0000 7f28a3fff640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f288c06be30 0x7f288c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:15.806 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.787+0000 7f28a3fff640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f288c06be30 0x7f288c06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f28ac072600 tx=0x7f2894009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:15.807 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.791+0000 7f28a8ff9640 1 -- 172.21.15.87:0/2517596749 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f289c079930 con 0x7f28ac0b56c0 2024-05-09T08:02:15.982 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.965+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f28ac1d2a70 con 0x7f288c06be30 2024-05-09T08:02:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.966+0000 7f28a8ff9640 1 -- 172.21.15.87:0/2517596749 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f28ac1d2a70 con 0x7f288c06be30 2024-05-09T08:02:15.983 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 1 to deep-scrub 2024-05-09T08:02:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f288c06be30 msgr2=0x7f288c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f288c06be30 0x7f288c06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f28ac072600 tx=0x7f2894009040 comp rx=0 tx=0).stop 2024-05-09T08:02:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac0b56c0 msgr2=0x7f28ac0ba630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:15.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac0b56c0 0x7f28ac0ba630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f289c035040 tx=0x7f289c0046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 shutdown_connections 2024-05-09T08:02:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f288c06be30 0x7f288c06e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28ac14bbd0 0x7f28ac1e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28ac14b080 0x7f28ac1e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 --2- 172.21.15.87:0/2517596749 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f28ac0b56c0 0x7f28ac0ba630 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 >> 172.21.15.87:0/2517596749 conn(0x7f28ac0b6950 msgr2=0x7f28ac071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 shutdown_connections 2024-05-09T08:02:15.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:15.968+0000 7f28b1d9e640 1 -- 172.21.15.87:0/2517596749 wait complete. 2024-05-09T08:02:15.996 INFO:tasks.ceph:Scrubbing osd.2 2024-05-09T08:02:15.996 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-09T08:02:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.083+0000 7f502ce9a640 1 Processor -- start 2024-05-09T08:02:16.100 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.083+0000 7f502ce9a640 1 -- start start 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f502ce9a640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50280ba020 0x7f502814ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f502ce9a640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50280ba400 con 0x7f502814b2d0 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f502ce9a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50280b5f20 con 0x7f50280b9560 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f502ce9a640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f50280b4b90 con 0x7f50280ba020 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f502659c640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f50280ba020 0x7f502814ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f5026d9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f502814b2d0 0x7f50281520c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59526/0 (socket says 172.21.15.87:59526) 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f5026d9d640 1 -- 172.21.15.87:0/1633899850 learned_addr learned my addr 172.21.15.87:0/1633899850 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f502659c640 1 -- 172.21.15.87:0/1633899850 >> v1:172.21.15.110:6789/0 conn(0x7f50280b9560 legacy=0x7f5028141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f502659c640 1 -- 172.21.15.87:0/1633899850 >> v1:172.21.15.87:6789/0 conn(0x7f502814b2d0 legacy=0x7f50281520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f502659c640 1 -- 172.21.15.87:0/1633899850 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50280b4de0 con 0x7f50280ba020 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.084+0000 7f5025d9b640 1 -- 172.21.15.87:0/1633899850 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798255223 0 0) 0x7f50280ba400 con 0x7f502814b2d0 2024-05-09T08:02:16.102 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.085+0000 7f502659c640 1 --2- 172.21.15.87:0/1633899850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ba020 0x7f502814ad90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f50180097a0 tx=0x7f501802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db591477fd3cc42c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.085+0000 7f5025d9b640 1 -- 172.21.15.87:0/1633899850 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018037070 con 0x7f50280ba020 2024-05-09T08:02:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.085+0000 7f5025d9b640 1 -- 172.21.15.87:0/1633899850 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5018032440 con 0x7f50280ba020 2024-05-09T08:02:16.103 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.085+0000 7f5025d9b640 1 -- 172.21.15.87:0/1633899850 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018032810 con 0x7f50280ba020 2024-05-09T08:02:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.086+0000 7f502ce9a640 1 -- 172.21.15.87:0/1633899850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ba020 msgr2=0x7f502814ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.086+0000 7f502ce9a640 1 --2- 172.21.15.87:0/1633899850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ba020 0x7f502814ad90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f50180097a0 tx=0x7f501802a1a0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.086+0000 7f502ce9a640 1 -- 172.21.15.87:0/1633899850 shutdown_connections 2024-05-09T08:02:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.086+0000 7f502ce9a640 1 --2- 172.21.15.87:0/1633899850 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f50280ba020 0x7f502814ad90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.086+0000 7f502ce9a640 1 -- 172.21.15.87:0/1633899850 >> 172.21.15.87:0/1633899850 conn(0x7f50280671a0 msgr2=0x7f50280675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.086+0000 7f502ce9a640 1 -- 172.21.15.87:0/1633899850 shutdown_connections 2024-05-09T08:02:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.086+0000 7f502ce9a640 1 -- 172.21.15.87:0/1633899850 wait complete. 2024-05-09T08:02:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.087+0000 7f502ce9a640 1 Processor -- start 2024-05-09T08:02:16.104 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.087+0000 7f502ce9a640 1 -- start start 2024-05-09T08:02:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f502ce9a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50280b9560 0x7f50280b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f502ce9a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280ba020 0x7f50280b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f502ce9a640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f502814b2d0 0x7f50281d3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f502ce9a640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f50280b6c70 con 0x7f502814b2d0 2024-05-09T08:02:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f502ce9a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f50280b5a90 con 0x7f50280ba020 2024-05-09T08:02:16.106 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f502ce9a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5028141c40 con 0x7f50280b9560 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f5026d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f502814b2d0 0x7f50281d3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f5026d9d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f502814b2d0 0x7f50281d3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47132/0 (socket says 172.21.15.87:47132) 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f5026d9d640 1 -- 172.21.15.87:0/128923180 learned_addr learned my addr 172.21.15.87:0/128923180 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f501dd9b640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280ba020 0x7f50280b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f502659c640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50280b9560 0x7f50280b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f5026d9d640 1 -- 172.21.15.87:0/128923180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50280b9560 msgr2=0x7f50280b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f5026d9d640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50280b9560 0x7f50280b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f5026d9d640 1 -- 172.21.15.87:0/128923180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280ba020 msgr2=0x7f50280b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f5026d9d640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280ba020 0x7f50280b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f5026d9d640 1 -- 172.21.15.87:0/128923180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50280b0fb0 con 0x7f502814b2d0 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.088+0000 7f5026d9d640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f502814b2d0 0x7f50281d3ef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f502000c700 tx=0x7f502000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.089+0000 7f501f7fe640 1 -- 172.21.15.87:0/128923180 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020018070 con 0x7f502814b2d0 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.089+0000 7f501f7fe640 1 -- 172.21.15.87:0/128923180 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f502000ce10 con 0x7f502814b2d0 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.089+0000 7f501f7fe640 1 -- 172.21.15.87:0/128923180 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502000a860 con 0x7f502814b2d0 2024-05-09T08:02:16.107 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.089+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50281dd070 con 0x7f502814b2d0 2024-05-09T08:02:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.089+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50280b3990 con 0x7f502814b2d0 2024-05-09T08:02:16.108 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.090+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50281dd720 con 0x7f502814b2d0 2024-05-09T08:02:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.090+0000 7f501f7fe640 1 -- 172.21.15.87:0/128923180 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f502001b070 con 0x7f502814b2d0 2024-05-09T08:02:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.091+0000 7f501f7fe640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f500806be30 0x7f500806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.091+0000 7f502659c640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f500806be30 0x7f500806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.091+0000 7f501f7fe640 1 -- 172.21.15.87:0/128923180 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f502008a3e0 con 0x7f502814b2d0 2024-05-09T08:02:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.091+0000 7f501f7fe640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7f5008074210 0x7f50080766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.109 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.091+0000 7f501f7fe640 1 -- 172.21.15.87:0/128923180 --> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5008076d80 con 0x7f5008074210 2024-05-09T08:02:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.091+0000 7f501f7fe640 1 -- 172.21.15.87:0/128923180 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5020091050 con 0x7f502814b2d0 2024-05-09T08:02:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.091+0000 7f501dd9b640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7f5008074210 0x7f50080766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.091+0000 7f502659c640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f500806be30 0x7f500806e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5018034000 tx=0x7f501802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.091+0000 7f501dd9b640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7f5008074210 0x7f50080766b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.110 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.092+0000 7f501f7fe640 1 -- 172.21.15.87:0/128923180 <== osd.2 v2:172.21.15.87:6816/2336174143 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5008076d80 con 0x7f5008074210 2024-05-09T08:02:16.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 --> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f50280691f0 con 0x7f5008074210 2024-05-09T08:02:16.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f501f7fe640 1 -- 172.21.15.87:0/128923180 <== osd.2 v2:172.21.15.87:6816/2336174143 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f50280691f0 con 0x7f5008074210 2024-05-09T08:02:16.122 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:16.122 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T08:02:16.122 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7f5008074210 msgr2=0x7f50080766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6816/2336174143,v1:172.21.15.87:6817/2336174143] conn(0x7f5008074210 0x7f50080766b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f500806be30 msgr2=0x7f500806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f500806be30 0x7f500806e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5018034000 tx=0x7f501802e000 comp rx=0 tx=0).stop 2024-05-09T08:02:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f502814b2d0 msgr2=0x7f50281d3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 --2- 172.21.15.87:0/128923180 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f502814b2d0 0x7f50281d3ef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f502000c700 tx=0x7f502000cbc0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f5026d9d640 1 -- 172.21.15.87:0/128923180 reap_dead start 2024-05-09T08:02:16.123 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 shutdown_connections 2024-05-09T08:02:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 >> 172.21.15.87:0/128923180 conn(0x7f50280671a0 msgr2=0x7f5028145790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 shutdown_connections 2024-05-09T08:02:16.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.105+0000 7f502ce9a640 1 -- 172.21.15.87:0/128923180 wait complete. 2024-05-09T08:02:16.133 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-09T08:02:16.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.217+0000 7fb300f90640 1 Processor -- start 2024-05-09T08:02:16.234 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.217+0000 7fb300f90640 1 -- start start 2024-05-09T08:02:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb300f90640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb2fc067200 0x7fb2fc0b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.236 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb300f90640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc09b320 0x7fb2fc1416c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb300f90640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2fc141c00 0x7fb2fc14ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb300f90640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fb2fc073940 con 0x7fb2fc141c00 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb300f90640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fb2fc142060 con 0x7fb2fc067200 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb300f90640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb2fc0675e0 con 0x7fb2fc09b320 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2fad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2fc141c00 0x7fb2fc14ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2fad9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb2fc141c00 0x7fb2fc14ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47144/0 (socket says 172.21.15.87:47144) 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2fad9d640 1 -- 172.21.15.87:0/4099825038 learned_addr learned my addr 172.21.15.87:0/4099825038 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2fa59c640 1 --2- 172.21.15.87:0/4099825038 >> v2:172.21.15.110:3300/0 conn(0x7fb2fc067200 0x7fb2fc0b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2f1d9b640 1 --2- 172.21.15.87:0/4099825038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc09b320 0x7fb2fc1416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2fad9d640 1 -- 172.21.15.87:0/4099825038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc09b320 msgr2=0x7fb2fc1416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2fad9d640 1 --2- 172.21.15.87:0/4099825038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc09b320 0x7fb2fc1416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2fad9d640 1 -- 172.21.15.87:0/4099825038 >> v2:172.21.15.110:3300/0 conn(0x7fb2fc067200 msgr2=0x7fb2fc0b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2fad9d640 1 --2- 172.21.15.87:0/4099825038 >> v2:172.21.15.110:3300/0 conn(0x7fb2fc067200 0x7fb2fc0b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.237 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.218+0000 7fb2fad9d640 1 -- 172.21.15.87:0/4099825038 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2fc09b8b0 con 0x7fb2fc141c00 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.219+0000 7fb2fad9d640 1 --2- 172.21.15.87:0/4099825038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc141c00 0x7fb2fc14ae90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0ba540 tx=0x7fb2f402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50773511c29ee657 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.219+0000 7fb2f9d9b640 1 -- 172.21.15.87:0/4099825038 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4036070 con 0x7fb2fc141c00 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.219+0000 7fb2f9d9b640 1 -- 172.21.15.87:0/4099825038 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f4031600 con 0x7fb2fc141c00 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.219+0000 7fb2f9d9b640 1 -- 172.21.15.87:0/4099825038 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40319d0 con 0x7fb2fc141c00 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.220+0000 7fb300f90640 1 -- 172.21.15.87:0/4099825038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc141c00 msgr2=0x7fb2fc14ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.220+0000 7fb300f90640 1 --2- 172.21.15.87:0/4099825038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc141c00 0x7fb2fc14ae90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0ba540 tx=0x7fb2f402a610 comp rx=0 tx=0).stop 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.220+0000 7fb300f90640 1 -- 172.21.15.87:0/4099825038 shutdown_connections 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.220+0000 7fb300f90640 1 --2- 172.21.15.87:0/4099825038 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc141c00 0x7fb2fc14ae90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.220+0000 7fb300f90640 1 --2- 172.21.15.87:0/4099825038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc09b320 0x7fb2fc1416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.220+0000 7fb300f90640 1 --2- 172.21.15.87:0/4099825038 >> v2:172.21.15.110:3300/0 conn(0x7fb2fc067200 0x7fb2fc0b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.220+0000 7fb300f90640 1 -- 172.21.15.87:0/4099825038 >> 172.21.15.87:0/4099825038 conn(0x7fb2fc0b6190 msgr2=0x7fb2fc0b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.220+0000 7fb300f90640 1 -- 172.21.15.87:0/4099825038 shutdown_connections 2024-05-09T08:02:16.238 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.220+0000 7fb300f90640 1 -- 172.21.15.87:0/4099825038 wait complete. 2024-05-09T08:02:16.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb300f90640 1 Processor -- start 2024-05-09T08:02:16.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb300f90640 1 -- start start 2024-05-09T08:02:16.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb300f90640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc067200 0x7fb2fc145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb300f90640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc09b320 0x7fb2fc1dca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb300f90640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc141c00 0x7fb2fc1dcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.241 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb300f90640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fb2fc0b4d70 con 0x7fb2fc067200 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb300f90640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb2fc09be70 con 0x7fb2fc09b320 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb300f90640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fb2fc14b3d0 con 0x7fb2fc141c00 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb2fa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc067200 0x7fb2fc145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb2fa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc067200 0x7fb2fc145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47154/0 (socket says 172.21.15.87:47154) 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb2fa59c640 1 -- 172.21.15.87:0/1485133538 learned_addr learned my addr 172.21.15.87:0/1485133538 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb2f1d9b640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc09b320 0x7fb2fc1dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.221+0000 7fb2fad9d640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc141c00 0x7fb2fc1dcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2fa59c640 1 -- 172.21.15.87:0/1485133538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc141c00 msgr2=0x7fb2fc1dcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2fa59c640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc141c00 0x7fb2fc1dcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2fa59c640 1 -- 172.21.15.87:0/1485133538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc09b320 msgr2=0x7fb2fc1dca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2fa59c640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc09b320 0x7fb2fc1dca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2fa59c640 1 -- 172.21.15.87:0/1485133538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2fc142200 con 0x7fb2fc067200 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2f1d9b640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc09b320 0x7fb2fc1dca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:16.242 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2fa59c640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc067200 0x7fb2fc145cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00d800 tx=0x7fb2ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2f37fe640 1 -- 172.21.15.87:0/1485133538 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec00b6c0 con 0x7fb2fc067200 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2f37fe640 1 -- 172.21.15.87:0/1485133538 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ec019070 con 0x7fb2fc067200 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2fc146f30 con 0x7fb2fc067200 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb2f37fe640 1 -- 172.21.15.87:0/1485133538 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec00ba80 con 0x7fb2fc067200 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.222+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2fc147210 con 0x7fb2fc067200 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.223+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2fc1478e0 con 0x7fb2fc067200 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.223+0000 7fb2f37fe640 1 -- 172.21.15.87:0/1485133538 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2ec00bc20 con 0x7fb2fc067200 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.224+0000 7fb2f37fe640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.224+0000 7fb2f37fe640 1 -- 172.21.15.87:0/1485133538 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fb2ec08b350 con 0x7fb2fc067200 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.224+0000 7fb2f1d9b640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.243 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.224+0000 7fb2f1d9b640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc140bb0 tx=0x7fb2e4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.244 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.228+0000 7fb2f37fe640 1 -- 172.21.15.87:0/1485133538 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb2ec059d00 con 0x7fb2fc067200 2024-05-09T08:02:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.409+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fb2fc0691f0 con 0x7fb2dc06be30 2024-05-09T08:02:16.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.410+0000 7fb2f37fe640 1 -- 172.21.15.87:0/1485133538 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb2fc0691f0 con 0x7fb2dc06be30 2024-05-09T08:02:16.427 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 2 to deep-scrub 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb2dc06be30 msgr2=0x7fb2dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc140bb0 tx=0x7fb2e4008040 comp rx=0 tx=0).stop 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc067200 msgr2=0x7fb2fc145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc067200 0x7fb2fc145cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00d800 tx=0x7fb2ec00dcc0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 shutdown_connections 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fb2dc06be30 0x7fb2dc06e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2fc141c00 0x7fb2fc1dcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2fc09b320 0x7fb2fc1dca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 --2- 172.21.15.87:0/1485133538 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb2fc067200 0x7fb2fc145cf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 >> 172.21.15.87:0/1485133538 conn(0x7fb2fc0b6190 msgr2=0x7fb2fc06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 shutdown_connections 2024-05-09T08:02:16.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.412+0000 7fb300f90640 1 -- 172.21.15.87:0/1485133538 wait complete. 2024-05-09T08:02:16.440 INFO:tasks.ceph:Scrubbing osd.3 2024-05-09T08:02:16.440 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-09T08:02:16.546 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.530+0000 7f59a7645640 1 Processor -- start 2024-05-09T08:02:16.547 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.530+0000 7f59a7645640 1 -- start start 2024-05-09T08:02:16.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.530+0000 7f59a7645640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00ba020 0x7f59a014ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.548 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.530+0000 7f59a7645640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59a014b2d0 0x7f59a0141c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.530+0000 7f59a7645640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a00ba400 con 0x7f59a00b9560 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.530+0000 7f59a7645640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f59a00b4b90 con 0x7f59a014b2d0 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.530+0000 7f59a7645640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f59a00b5a90 con 0x7f59a00ba020 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f59a4be0640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f59a00b9560 0x7f59a0141530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59534/0 (socket says 172.21.15.87:59534) 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f59a4be0640 1 -- 172.21.15.87:0/2045815750 learned_addr learned my addr 172.21.15.87:0/2045815750 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f59a5be2640 1 --2- 172.21.15.87:0/2045815750 >> v2:172.21.15.110:3300/0 conn(0x7f59a014b2d0 0x7f59a0141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f59a53e1640 1 --2- 172.21.15.87:0/2045815750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00ba020 0x7f59a014ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f5997fff640 1 -- 172.21.15.87:0/2045815750 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958566910 0 0) 0x7f59a00ba400 con 0x7f59a00b9560 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f5997fff640 1 -- 172.21.15.87:0/2045815750 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f598c003520 con 0x7f59a00b9560 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f59a5be2640 1 -- 172.21.15.87:0/2045815750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00ba020 msgr2=0x7f59a014ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f59a5be2640 1 --2- 172.21.15.87:0/2045815750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00ba020 0x7f59a014ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f59a5be2640 1 -- 172.21.15.87:0/2045815750 >> v1:172.21.15.87:6789/0 conn(0x7f59a00b9560 legacy=0x7f59a0141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f59a5be2640 1 -- 172.21.15.87:0/2045815750 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a00b5f20 con 0x7f59a014b2d0 2024-05-09T08:02:16.549 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.531+0000 7f59a53e1640 1 --2- 172.21.15.87:0/2045815750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00ba020 0x7f59a014ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:02:16.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.532+0000 7f59a5be2640 1 --2- 172.21.15.87:0/2045815750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a014b2d0 0x7f59a0141c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f59a00b4d10 tx=0x7f599802a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a33ce39f58196e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.532+0000 7f5997fff640 1 -- 172.21.15.87:0/2045815750 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5998007740 con 0x7f59a014b2d0 2024-05-09T08:02:16.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.532+0000 7f5997fff640 1 -- 172.21.15.87:0/2045815750 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59980078e0 con 0x7f59a014b2d0 2024-05-09T08:02:16.550 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.532+0000 7f5997fff640 1 -- 172.21.15.87:0/2045815750 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5998007c90 con 0x7f59a014b2d0 2024-05-09T08:02:16.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.532+0000 7f59a7645640 1 -- 172.21.15.87:0/2045815750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a014b2d0 msgr2=0x7f59a0141c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.552 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.533+0000 7f59a7645640 1 --2- 172.21.15.87:0/2045815750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a014b2d0 0x7f59a0141c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f59a00b4d10 tx=0x7f599802a5b0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.533+0000 7f59a7645640 1 -- 172.21.15.87:0/2045815750 shutdown_connections 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.533+0000 7f59a7645640 1 --2- 172.21.15.87:0/2045815750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a014b2d0 0x7f59a0141c40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.533+0000 7f59a7645640 1 --2- 172.21.15.87:0/2045815750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00ba020 0x7f59a014ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.533+0000 7f59a7645640 1 -- 172.21.15.87:0/2045815750 >> 172.21.15.87:0/2045815750 conn(0x7f59a00671a0 msgr2=0x7f59a00675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.533+0000 7f59a7645640 1 -- 172.21.15.87:0/2045815750 shutdown_connections 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.533+0000 7f59a7645640 1 -- 172.21.15.87:0/2045815750 wait complete. 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a7645640 1 Processor -- start 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a7645640 1 -- start start 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a7645640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00b9560 0x7f59a0144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a7645640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a00ba020 0x7f59a0142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a7645640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59a014b2d0 0x7f59a01e0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a7645640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00b5400 con 0x7f59a014b2d0 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a7645640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00b6c70 con 0x7f59a00ba020 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a7645640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f59a00b5580 con 0x7f59a00b9560 2024-05-09T08:02:16.553 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a5be2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59a014b2d0 0x7f59a01e0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a5be2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59a014b2d0 0x7f59a01e0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47164/0 (socket says 172.21.15.87:47164) 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a5be2640 1 -- 172.21.15.87:0/2903288459 learned_addr learned my addr 172.21.15.87:0/2903288459 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a4be0640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a00ba020 0x7f59a0142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.534+0000 7f59a53e1640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00b9560 0x7f59a0144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f59a5be2640 1 -- 172.21.15.87:0/2903288459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00b9560 msgr2=0x7f59a0144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f59a5be2640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59a00b9560 0x7f59a0144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f59a5be2640 1 -- 172.21.15.87:0/2903288459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a00ba020 msgr2=0x7f59a0142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f59a5be2640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a00ba020 0x7f59a0142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f59a5be2640 1 -- 172.21.15.87:0/2903288459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a0148900 con 0x7f59a014b2d0 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f59a5be2640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59a014b2d0 0x7f59a01e0670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f599802aba0 tx=0x7f5998004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f5995ffb640 1 -- 172.21.15.87:0/2903288459 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599803f070 con 0x7f59a014b2d0 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f5995ffb640 1 -- 172.21.15.87:0/2903288459 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5998031c60 con 0x7f59a014b2d0 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a0144550 con 0x7f59a014b2d0 2024-05-09T08:02:16.554 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f5995ffb640 1 -- 172.21.15.87:0/2903288459 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5998009450 con 0x7f59a014b2d0 2024-05-09T08:02:16.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.535+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a0148100 con 0x7f59a014b2d0 2024-05-09T08:02:16.555 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.536+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59a00691f0 con 0x7f59a014b2d0 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.537+0000 7f5995ffb640 1 -- 172.21.15.87:0/2903288459 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f599803b410 con 0x7f59a014b2d0 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.537+0000 7f5995ffb640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f598406be30 0x7f598406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.537+0000 7f5995ffb640 1 -- 172.21.15.87:0/2903288459 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f59980ac0a0 con 0x7f59a014b2d0 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.537+0000 7f59a53e1640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f598406be30 0x7f598406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.537+0000 7f5995ffb640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7f5984074210 0x7f59840766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.537+0000 7f5995ffb640 1 -- 172.21.15.87:0/2903288459 --> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f599800aea0 con 0x7f5984074210 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.537+0000 7f5995ffb640 1 -- 172.21.15.87:0/2903288459 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f59980b3050 con 0x7f59a014b2d0 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.537+0000 7f59a4be0640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7f5984074210 0x7f59840766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.538+0000 7f59a53e1640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f598406be30 0x7f598406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f599c009560 tx=0x7f599c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.538+0000 7f59a4be0640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7f5984074210 0x7f59840766b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.556 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.538+0000 7f5995ffb640 1 -- 172.21.15.87:0/2903288459 <== osd.3 v2:172.21.15.87:6824/61362060 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f599800aea0 con 0x7f5984074210 2024-05-09T08:02:16.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.551+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 --> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f59a00b6990 con 0x7f5984074210 2024-05-09T08:02:16.568 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f5995ffb640 1 -- 172.21.15.87:0/2903288459 <== osd.3 v2:172.21.15.87:6824/61362060 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f59a00b6990 con 0x7f5984074210 2024-05-09T08:02:16.568 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:16.568 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T08:02:16.568 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:16.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7f5984074210 msgr2=0x7f59840766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6824/61362060,v1:172.21.15.87:6825/61362060] conn(0x7f5984074210 0x7f59840766b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f598406be30 msgr2=0x7f598406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f598406be30 0x7f598406e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f599c009560 tx=0x7f599c009190 comp rx=0 tx=0).stop 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59a014b2d0 msgr2=0x7f59a01e0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 --2- 172.21.15.87:0/2903288459 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f59a014b2d0 0x7f59a01e0670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f599802aba0 tx=0x7f5998004a40 comp rx=0 tx=0).stop 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a5be2640 1 -- 172.21.15.87:0/2903288459 reap_dead start 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 shutdown_connections 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 >> 172.21.15.87:0/2903288459 conn(0x7f59a00671a0 msgr2=0x7f59a01404f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 shutdown_connections 2024-05-09T08:02:16.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.552+0000 7f59a7645640 1 -- 172.21.15.87:0/2903288459 wait complete. 2024-05-09T08:02:16.579 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-09T08:02:16.680 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.664+0000 7fa622510640 1 Processor -- start 2024-05-09T08:02:16.681 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.664+0000 7fa622510640 1 -- start start 2024-05-09T08:02:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.664+0000 7fa622510640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa61c072be0 0x7fa61c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.664+0000 7fa622510640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa61c06d630 0x7fa61c148c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.664+0000 7fa622510640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa61c0b11d0 con 0x7fa61c149160 2024-05-09T08:02:16.682 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.664+0000 7fa622510640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fa61c072fc0 con 0x7fa61c072be0 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.664+0000 7fa622510640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fa61c0b2640 con 0x7fa61c06d630 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa61bfff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa61c072be0 0x7fa61c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa620aad640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fa61c149160 0x7fa61c1456b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59546/0 (socket says 172.21.15.87:59546) 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa620aad640 1 -- 172.21.15.87:0/3836122057 learned_addr learned my addr 172.21.15.87:0/3836122057 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa613fff640 1 --2- 172.21.15.87:0/3836122057 >> v2:172.21.15.110:3300/0 conn(0x7fa61c06d630 0x7fa61c148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa61bfff640 1 -- 172.21.15.87:0/3836122057 >> v2:172.21.15.110:3300/0 conn(0x7fa61c06d630 msgr2=0x7fa61c148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa61bfff640 1 --2- 172.21.15.87:0/3836122057 >> v2:172.21.15.110:3300/0 conn(0x7fa61c06d630 0x7fa61c148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa61bfff640 1 -- 172.21.15.87:0/3836122057 >> v1:172.21.15.87:6789/0 conn(0x7fa61c149160 legacy=0x7fa61c1456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa61bfff640 1 -- 172.21.15.87:0/3836122057 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61c0b2920 con 0x7fa61c072be0 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa61b7fe640 1 -- 172.21.15.87:0/3836122057 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802804009 0 0) 0x7fa61c0b11d0 con 0x7fa61c149160 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.665+0000 7fa613fff640 1 --2- 172.21.15.87:0/3836122057 >> v2:172.21.15.110:3300/0 conn(0x7fa61c06d630 0x7fa61c148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa61bfff640 1 --2- 172.21.15.87:0/3836122057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c072be0 0x7fa61c0b0950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0b0020 tx=0x7fa60c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90ade170ccdc93d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa61b7fe640 1 -- 172.21.15.87:0/3836122057 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c037070 con 0x7fa61c072be0 2024-05-09T08:02:16.683 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa61b7fe640 1 -- 172.21.15.87:0/3836122057 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa60c02add0 con 0x7fa61c072be0 2024-05-09T08:02:16.684 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa61b7fe640 1 -- 172.21.15.87:0/3836122057 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c032660 con 0x7fa61c072be0 2024-05-09T08:02:16.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa622510640 1 -- 172.21.15.87:0/3836122057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c072be0 msgr2=0x7fa61c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa622510640 1 --2- 172.21.15.87:0/3836122057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c072be0 0x7fa61c0b0950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0b0020 tx=0x7fa60c02a080 comp rx=0 tx=0).stop 2024-05-09T08:02:16.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa622510640 1 -- 172.21.15.87:0/3836122057 shutdown_connections 2024-05-09T08:02:16.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa622510640 1 --2- 172.21.15.87:0/3836122057 >> v2:172.21.15.110:3300/0 conn(0x7fa61c06d630 0x7fa61c148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa622510640 1 --2- 172.21.15.87:0/3836122057 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c072be0 0x7fa61c0b0950 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa622510640 1 -- 172.21.15.87:0/3836122057 >> 172.21.15.87:0/3836122057 conn(0x7fa61c0b5860 msgr2=0x7fa61c0b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:16.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa622510640 1 -- 172.21.15.87:0/3836122057 shutdown_connections 2024-05-09T08:02:16.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.666+0000 7fa622510640 1 -- 172.21.15.87:0/3836122057 wait complete. 2024-05-09T08:02:16.687 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.667+0000 7fa622510640 1 Processor -- start 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.667+0000 7fa622510640 1 -- start start 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa622510640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa61c06d630 0x7fa61c071e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa622510640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa61c072be0 0x7fa61c1ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa622510640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c149160 0x7fa61c0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa622510640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fa61c0b22a0 con 0x7fa61c149160 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa622510640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa61c0b1860 con 0x7fa61c06d630 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa622510640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fa61c0b2420 con 0x7fa61c072be0 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa620aad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c149160 0x7fa61c0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa620aad640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c149160 0x7fa61c0aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47182/0 (socket says 172.21.15.87:47182) 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa620aad640 1 -- 172.21.15.87:0/3943933893 learned_addr learned my addr 172.21.15.87:0/3943933893 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa61bfff640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa61c06d630 0x7fa61c071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa620aad640 1 -- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa61c072be0 msgr2=0x7fa61c1ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa613fff640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa61c072be0 0x7fa61c1ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.688 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa620aad640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa61c072be0 0x7fa61c1ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa620aad640 1 -- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa61c06d630 msgr2=0x7fa61c071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa620aad640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa61c06d630 0x7fa61c071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa620aad640 1 -- 172.21.15.87:0/3943933893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61c1d07e0 con 0x7fa61c149160 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa61bfff640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa61c06d630 0x7fa61c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa613fff640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa61c072be0 0x7fa61c1ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa620aad640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c149160 0x7fa61c0aefd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c780 tx=0x7fa61400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.668+0000 7fa6197fa640 1 -- 172.21.15.87:0/3943933893 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614018070 con 0x7fa61c149160 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.669+0000 7fa6197fa640 1 -- 172.21.15.87:0/3943933893 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61400a640 con 0x7fa61c149160 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.669+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa61c1d0ac0 con 0x7fa61c149160 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.669+0000 7fa6197fa640 1 -- 172.21.15.87:0/3943933893 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61400aa30 con 0x7fa61c149160 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.669+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa61c1cf050 con 0x7fa61c149160 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.669+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa61c0691f0 con 0x7fa61c149160 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.670+0000 7fa6197fa640 1 -- 172.21.15.87:0/3943933893 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa61401b070 con 0x7fa61c149160 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.670+0000 7fa6197fa640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa5fc06be60 0x7fa5fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.689 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.671+0000 7fa6197fa640 1 -- 172.21.15.87:0/3943933893 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fa61408a570 con 0x7fa61c149160 2024-05-09T08:02:16.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.671+0000 7fa61bfff640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa5fc06be60 0x7fa5fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.690 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.671+0000 7fa61bfff640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa5fc06be60 0x7fa5fc06e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa60c034000 tx=0x7fa60c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.691 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.675+0000 7fa6197fa640 1 -- 172.21.15.87:0/3943933893 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fa614058e00 con 0x7fa61c149160 2024-05-09T08:02:16.864 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.848+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa61c073160 con 0x7fa5fc06be60 2024-05-09T08:02:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.848+0000 7fa6197fa640 1 -- 172.21.15.87:0/3943933893 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa61c073160 con 0x7fa5fc06be60 2024-05-09T08:02:16.865 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 3 to deep-scrub 2024-05-09T08:02:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa5fc06be60 msgr2=0x7fa5fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa5fc06be60 0x7fa5fc06e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa60c034000 tx=0x7fa60c02e000 comp rx=0 tx=0).stop 2024-05-09T08:02:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c149160 msgr2=0x7fa61c0aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c149160 0x7fa61c0aefd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c780 tx=0x7fa61400cc40 comp rx=0 tx=0).stop 2024-05-09T08:02:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 shutdown_connections 2024-05-09T08:02:16.867 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fa5fc06be60 0x7fa5fc06e320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa61c072be0 0x7fa61c1ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa61c149160 0x7fa61c0aefd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 --2- 172.21.15.87:0/3943933893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa61c06d630 0x7fa61c071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 >> 172.21.15.87:0/3943933893 conn(0x7fa61c0b5860 msgr2=0x7fa61c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 shutdown_connections 2024-05-09T08:02:16.868 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.850+0000 7fa622510640 1 -- 172.21.15.87:0/3943933893 wait complete. 2024-05-09T08:02:16.878 INFO:tasks.ceph:Scrubbing osd.4 2024-05-09T08:02:16.878 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-09T08:02:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb11a10640 1 Processor -- start 2024-05-09T08:02:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb11a10640 1 -- start start 2024-05-09T08:02:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb11a10640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 0x7fdb0c141530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb11a10640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdb0c141a70 0x7fdb0c1520c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb11a10640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0c0ba400 con 0x7fdb0c0ba020 2024-05-09T08:02:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb11a10640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fdb0c0b4b90 con 0x7fdb0c141a70 2024-05-09T08:02:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb11a10640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0c0b5a90 con 0x7fdb0c0b9560 2024-05-09T08:02:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb0b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdb0c141a70 0x7fdb0c1520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.984 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb0affd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fdb0c0ba020 0x7fdb0c14ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:52140/0 (socket says 172.21.15.87:52140) 2024-05-09T08:02:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb027fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 0x7fdb0c141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.968+0000 7fdb0affd640 1 -- 172.21.15.87:0/450073215 learned_addr learned my addr 172.21.15.87:0/450073215 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:16.985 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.967+0000 7fdb0b7fe640 1 --2- 172.21.15.87:0/450073215 >> v2:172.21.15.110:3300/0 conn(0x7fdb0c141a70 0x7fdb0c1520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:47686/0 (socket says 172.21.15.87:47686) 2024-05-09T08:02:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.968+0000 7fdb027fc640 1 -- 172.21.15.87:0/450073215 >> v2:172.21.15.110:3300/0 conn(0x7fdb0c141a70 msgr2=0x7fdb0c1520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.968+0000 7fdb027fc640 1 --2- 172.21.15.87:0/450073215 >> v2:172.21.15.110:3300/0 conn(0x7fdb0c141a70 0x7fdb0c1520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.968+0000 7fdb027fc640 1 -- 172.21.15.87:0/450073215 >> v1:172.21.15.110:6789/0 conn(0x7fdb0c0ba020 legacy=0x7fdb0c14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.986 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.968+0000 7fdb027fc640 1 -- 172.21.15.87:0/450073215 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c0b5f20 con 0x7fdb0c0b9560 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.968+0000 7fdb0b7fe640 1 --2- 172.21.15.87:0/450073215 >> v2:172.21.15.110:3300/0 conn(0x7fdb0c141a70 0x7fdb0c1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb027fc640 1 --2- 172.21.15.87:0/450073215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 0x7fdb0c141530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0b4d10 tx=0x7fdaf402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=879c6031b86f7974 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb0a7fc640 1 -- 172.21.15.87:0/450073215 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4037070 con 0x7fdb0c0b9560 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb0a7fc640 1 -- 172.21.15.87:0/450073215 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf402ae50 con 0x7fdb0c0b9560 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb0a7fc640 1 -- 172.21.15.87:0/450073215 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4032660 con 0x7fdb0c0b9560 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb11a10640 1 -- 172.21.15.87:0/450073215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 msgr2=0x7fdb0c141530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb11a10640 1 --2- 172.21.15.87:0/450073215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 0x7fdb0c141530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0b4d10 tx=0x7fdaf402a100 comp rx=0 tx=0).stop 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb11a10640 1 -- 172.21.15.87:0/450073215 shutdown_connections 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb11a10640 1 --2- 172.21.15.87:0/450073215 >> v2:172.21.15.110:3300/0 conn(0x7fdb0c141a70 0x7fdb0c1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb11a10640 1 --2- 172.21.15.87:0/450073215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 0x7fdb0c141530 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb11a10640 1 -- 172.21.15.87:0/450073215 >> 172.21.15.87:0/450073215 conn(0x7fdb0c0671a0 msgr2=0x7fdb0c0675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb11a10640 1 -- 172.21.15.87:0/450073215 shutdown_connections 2024-05-09T08:02:16.987 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.969+0000 7fdb11a10640 1 -- 172.21.15.87:0/450073215 wait complete. 2024-05-09T08:02:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.970+0000 7fdb11a10640 1 Processor -- start 2024-05-09T08:02:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.970+0000 7fdb11a10640 1 -- start start 2024-05-09T08:02:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb11a10640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 0x7fdb0c142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb11a10640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb0c0ba020 0x7fdb0c1dd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb11a10640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb0c141a70 0x7fdb0c1ddac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb11a10640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c141ec0 con 0x7fdb0c0ba020 2024-05-09T08:02:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb11a10640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c0b6c70 con 0x7fdb0c141a70 2024-05-09T08:02:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb11a10640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0c14b4a0 con 0x7fdb0c0b9560 2024-05-09T08:02:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb027fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb0c0ba020 0x7fdb0c1dd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb027fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb0c0ba020 0x7fdb0c1dd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47188/0 (socket says 172.21.15.87:47188) 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb027fc640 1 -- 172.21.15.87:0/1736369974 learned_addr learned my addr 172.21.15.87:0/1736369974 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb0b7fe640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb0c141a70 0x7fdb0c1ddac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb0affd640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 0x7fdb0c142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb027fc640 1 -- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 msgr2=0x7fdb0c142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb027fc640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 0x7fdb0c142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb027fc640 1 -- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb0c141a70 msgr2=0x7fdb0c1ddac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb027fc640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb0c141a70 0x7fdb0c1ddac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb027fc640 1 -- 172.21.15.87:0/1736369974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c142d70 con 0x7fdb0c0ba020 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.971+0000 7fdb0affd640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb0c0b9560 0x7fdb0c142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.972+0000 7fdb027fc640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb0c0ba020 0x7fdb0c1dd580 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4000c00 tx=0x7fdaf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.972+0000 7fdb08ff9640 1 -- 172.21.15.87:0/1736369974 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4041070 con 0x7fdb0c0ba020 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.972+0000 7fdb08ff9640 1 -- 172.21.15.87:0/1736369974 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf403c460 con 0x7fdb0c0ba020 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.972+0000 7fdb08ff9640 1 -- 172.21.15.87:0/1736369974 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4037040 con 0x7fdb0c0ba020 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.972+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0c143050 con 0x7fdb0c0ba020 2024-05-09T08:02:16.992 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.972+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0c1475b0 con 0x7fdb0c0ba020 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.973+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb0c0691f0 con 0x7fdb0c0ba020 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.973+0000 7fdb08ff9640 1 -- 172.21.15.87:0/1736369974 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdaf4044070 con 0x7fdb0c0ba020 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.974+0000 7fdb08ff9640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdaec06be30 0x7fdaec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.974+0000 7fdb0affd640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdaec06be30 0x7fdaec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.974+0000 7fdb08ff9640 1 -- 172.21.15.87:0/1736369974 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fdaf40ab4e0 con 0x7fdb0c0ba020 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.974+0000 7fdb08ff9640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7fdaec074210 0x7fdaec0766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.974+0000 7fdb08ff9640 1 -- 172.21.15.87:0/1736369974 --> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdaec076d80 con 0x7fdaec074210 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.974+0000 7fdb08ff9640 1 -- 172.21.15.87:0/1736369974 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdaf40b2050 con 0x7fdb0c0ba020 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.974+0000 7fdb0affd640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdaec06be30 0x7fdaec06e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c1480e0 tx=0x7fdafc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.974+0000 7fdb0b7fe640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7fdaec074210 0x7fdaec0766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:16.993 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.974+0000 7fdb0b7fe640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7fdaec074210 0x7fdaec0766b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:16.994 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.975+0000 7fdb08ff9640 1 -- 172.21.15.87:0/1736369974 <== osd.4 v2:172.21.15.110:6823/1484209221 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdaec076d80 con 0x7fdaec074210 2024-05-09T08:02:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.988+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 --> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdb0c0bbbd0 con 0x7fdaec074210 2024-05-09T08:02:17.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb08ff9640 1 -- 172.21.15.87:0/1736369974 <== osd.4 v2:172.21.15.110:6823/1484209221 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdb0c0bbbd0 con 0x7fdaec074210 2024-05-09T08:02:17.005 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:17.006 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T08:02:17.006 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7fdaec074210 msgr2=0x7fdaec0766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.110:6823/1484209221,v1:172.21.15.110:6825/1484209221] conn(0x7fdaec074210 0x7fdaec0766b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdaec06be30 msgr2=0x7fdaec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fdaec06be30 0x7fdaec06e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c1480e0 tx=0x7fdafc009040 comp rx=0 tx=0).stop 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb0c0ba020 msgr2=0x7fdb0c1dd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 --2- 172.21.15.87:0/1736369974 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb0c0ba020 0x7fdb0c1dd580 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4000c00 tx=0x7fdaf40046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb0b7fe640 1 -- 172.21.15.87:0/1736369974 reap_dead start 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 shutdown_connections 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 >> 172.21.15.87:0/1736369974 conn(0x7fdb0c0671a0 msgr2=0x7fdb0c0bc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:17.007 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 shutdown_connections 2024-05-09T08:02:17.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:16.989+0000 7fdb11a10640 1 -- 172.21.15.87:0/1736369974 wait complete. 2024-05-09T08:02:17.017 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-09T08:02:17.118 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.102+0000 7ffb28bd5640 1 Processor -- start 2024-05-09T08:02:17.119 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.102+0000 7ffb28bd5640 1 -- start start 2024-05-09T08:02:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.102+0000 7ffb28bd5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffb240af130 0x7ffb240b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.102+0000 7ffb28bd5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240b3ba0 0x7ffb240b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.102+0000 7ffb28bd5640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb240b0ca0 con 0x7ffb240b3760 2024-05-09T08:02:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.102+0000 7ffb28bd5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ffb240af610 con 0x7ffb240af130 2024-05-09T08:02:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.102+0000 7ffb28bd5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffb240af8f0 con 0x7ffb240b3ba0 2024-05-09T08:02:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb1bfff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ffb240b3760 0x7ffb24143f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59558/0 (socket says 172.21.15.87:59558) 2024-05-09T08:02:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb1bfff640 1 -- 172.21.15.87:0/2373635492 learned_addr learned my addr 172.21.15.87:0/2373635492 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:17.120 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb2259c640 1 --2- 172.21.15.87:0/2373635492 >> v2:172.21.15.110:3300/0 conn(0x7ffb240af130 0x7ffb240b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb22d9d640 1 --2- 172.21.15.87:0/2373635492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240b3ba0 0x7ffb240b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb21d9b640 1 -- 172.21.15.87:0/2373635492 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268251752 0 0) 0x7ffb240b0ca0 con 0x7ffb240b3760 2024-05-09T08:02:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb21d9b640 1 -- 172.21.15.87:0/2373635492 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb10003520 con 0x7ffb240b3760 2024-05-09T08:02:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb2259c640 1 -- 172.21.15.87:0/2373635492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240b3ba0 msgr2=0x7ffb240b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb21d9b640 1 -- 172.21.15.87:0/2373635492 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3972915006 0 0) 0x7ffb10003520 con 0x7ffb240b3760 2024-05-09T08:02:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb2259c640 1 --2- 172.21.15.87:0/2373635492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240b3ba0 0x7ffb240b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb2259c640 1 -- 172.21.15.87:0/2373635492 >> v1:172.21.15.87:6789/0 conn(0x7ffb240b3760 legacy=0x7ffb24143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.121 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.103+0000 7ffb2259c640 1 -- 172.21.15.87:0/2373635492 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb240b0920 con 0x7ffb240af130 2024-05-09T08:02:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.104+0000 7ffb2259c640 1 --2- 172.21.15.87:0/2373635492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb240af130 0x7ffb240b4260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb140097a0 tx=0x7ffb1402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d0137a06206dbd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.104+0000 7ffb21d9b640 1 -- 172.21.15.87:0/2373635492 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14037070 con 0x7ffb240af130 2024-05-09T08:02:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.104+0000 7ffb21d9b640 1 -- 172.21.15.87:0/2373635492 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1402aba0 con 0x7ffb240af130 2024-05-09T08:02:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.104+0000 7ffb21d9b640 1 -- 172.21.15.87:0/2373635492 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c001670 con 0x7ffb240af130 2024-05-09T08:02:17.124 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.104+0000 7ffb28bd5640 1 -- 172.21.15.87:0/2373635492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb240af130 msgr2=0x7ffb240b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.105+0000 7ffb28bd5640 1 --2- 172.21.15.87:0/2373635492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb240af130 0x7ffb240b4260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffb140097a0 tx=0x7ffb1402a110 comp rx=0 tx=0).stop 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.105+0000 7ffb28bd5640 1 -- 172.21.15.87:0/2373635492 shutdown_connections 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.105+0000 7ffb28bd5640 1 --2- 172.21.15.87:0/2373635492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240b3ba0 0x7ffb240b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.105+0000 7ffb28bd5640 1 --2- 172.21.15.87:0/2373635492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb240af130 0x7ffb240b4260 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.105+0000 7ffb28bd5640 1 -- 172.21.15.87:0/2373635492 >> 172.21.15.87:0/2373635492 conn(0x7ffb240b5860 msgr2=0x7ffb240b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.105+0000 7ffb28bd5640 1 -- 172.21.15.87:0/2373635492 shutdown_connections 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.105+0000 7ffb28bd5640 1 -- 172.21.15.87:0/2373635492 wait complete. 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.106+0000 7ffb28bd5640 1 Processor -- start 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.106+0000 7ffb28bd5640 1 -- start start 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.106+0000 7ffb28bd5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240af130 0x7ffb241cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.106+0000 7ffb28bd5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb240b3760 0x7ffb24146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.106+0000 7ffb28bd5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb240b3ba0 0x7ffb2413ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.106+0000 7ffb28bd5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ffb241447b0 con 0x7ffb240b3760 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.106+0000 7ffb28bd5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffb24144630 con 0x7ffb240b3ba0 2024-05-09T08:02:17.125 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.106+0000 7ffb28bd5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ffb24147b10 con 0x7ffb240af130 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.106+0000 7ffb1bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb240b3760 0x7ffb24146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1bfff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb240b3760 0x7ffb24146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47196/0 (socket says 172.21.15.87:47196) 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1bfff640 1 -- 172.21.15.87:0/1354591071 learned_addr learned my addr 172.21.15.87:0/1354591071 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb22d9d640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb240b3ba0 0x7ffb2413ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb2259c640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240af130 0x7ffb241cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1bfff640 1 -- 172.21.15.87:0/1354591071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240af130 msgr2=0x7ffb241cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1bfff640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240af130 0x7ffb241cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1bfff640 1 -- 172.21.15.87:0/1354591071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb240b3ba0 msgr2=0x7ffb2413ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1bfff640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb240b3ba0 0x7ffb2413ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1bfff640 1 -- 172.21.15.87:0/1354591071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2409aec0 con 0x7ffb240b3760 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1bfff640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb240b3760 0x7ffb24146690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0011e0 tx=0x7ffb0c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1affd640 1 -- 172.21.15.87:0/1354591071 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c017070 con 0x7ffb240b3760 2024-05-09T08:02:17.126 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1affd640 1 -- 172.21.15.87:0/1354591071 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0c005ad0 con 0x7ffb240b3760 2024-05-09T08:02:17.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb24145e90 con 0x7ffb240b3760 2024-05-09T08:02:17.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb1affd640 1 -- 172.21.15.87:0/1354591071 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c007070 con 0x7ffb240b3760 2024-05-09T08:02:17.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.107+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb241dc4b0 con 0x7ffb240b3760 2024-05-09T08:02:17.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.108+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb24068c50 con 0x7ffb240b3760 2024-05-09T08:02:17.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.109+0000 7ffb1affd640 1 -- 172.21.15.87:0/1354591071 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb0c01a070 con 0x7ffb240b3760 2024-05-09T08:02:17.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.109+0000 7ffb1affd640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb0406be30 0x7ffb0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.109+0000 7ffb2259c640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb0406be30 0x7ffb0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.109+0000 7ffb1affd640 1 -- 172.21.15.87:0/1354591071 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ffb0c08a2d0 con 0x7ffb240b3760 2024-05-09T08:02:17.128 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.110+0000 7ffb2259c640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb0406be30 0x7ffb0406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffb14034000 tx=0x7ffb1402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.130 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.114+0000 7ffb1affd640 1 -- 172.21.15.87:0/1354591071 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffb24068c50 con 0x7ffb240b3760 2024-05-09T08:02:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.292+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ffb240691f0 con 0x7ffb0406be30 2024-05-09T08:02:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.292+0000 7ffb1affd640 1 -- 172.21.15.87:0/1354591071 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffb240691f0 con 0x7ffb0406be30 2024-05-09T08:02:17.309 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 4 to deep-scrub 2024-05-09T08:02:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb0406be30 msgr2=0x7ffb0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb0406be30 0x7ffb0406e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ffb14034000 tx=0x7ffb1402e000 comp rx=0 tx=0).stop 2024-05-09T08:02:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb240b3760 msgr2=0x7ffb24146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb240b3760 0x7ffb24146690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0011e0 tx=0x7ffb0c00cbe0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 shutdown_connections 2024-05-09T08:02:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ffb0406be30 0x7ffb0406e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffb240b3ba0 0x7ffb2413ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffb240b3760 0x7ffb24146690 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 --2- 172.21.15.87:0/1354591071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffb240af130 0x7ffb241cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 >> 172.21.15.87:0/1354591071 conn(0x7ffb240b5860 msgr2=0x7ffb240ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.294+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 shutdown_connections 2024-05-09T08:02:17.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.295+0000 7ffb28bd5640 1 -- 172.21.15.87:0/1354591071 wait complete. 2024-05-09T08:02:17.323 INFO:tasks.ceph:Scrubbing osd.5 2024-05-09T08:02:17.323 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-09T08:02:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.410+0000 7f6e218b3640 1 Processor -- start 2024-05-09T08:02:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.410+0000 7f6e218b3640 1 -- start start 2024-05-09T08:02:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.410+0000 7f6e218b3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c0ba020 0x7f6e1c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.410+0000 7f6e218b3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6e1c14b2d0 0x7f6e1c141c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.410+0000 7f6e218b3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e1c0ba400 con 0x7f6e1c0b9560 2024-05-09T08:02:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.410+0000 7f6e218b3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f6e1c0b4b90 con 0x7f6e1c14b2d0 2024-05-09T08:02:17.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.410+0000 7f6e218b3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c0b5a90 con 0x7f6e1c0ba020 2024-05-09T08:02:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e1affd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c0ba020 0x7f6e1c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e1b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6e1c14b2d0 0x7f6e1c141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e1affd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c0ba020 0x7f6e1c14ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:41802/0 (socket says 172.21.15.87:41802) 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e1affd640 1 -- 172.21.15.87:0/3134044423 learned_addr learned my addr 172.21.15.87:0/3134044423 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e127fc640 1 --1- 172.21.15.87:0/3134044423 >> v1:172.21.15.110:6789/0 conn(0x7f6e1c0b9560 0x7f6e1c141530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:52154/0 (socket says 172.21.15.87:52154) 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e1affd640 1 -- 172.21.15.87:0/3134044423 >> v2:172.21.15.110:3300/0 conn(0x7f6e1c14b2d0 msgr2=0x7f6e1c141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e1affd640 1 --2- 172.21.15.87:0/3134044423 >> v2:172.21.15.110:3300/0 conn(0x7f6e1c14b2d0 0x7f6e1c141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e1affd640 1 -- 172.21.15.87:0/3134044423 >> v1:172.21.15.110:6789/0 conn(0x7f6e1c0b9560 legacy=0x7f6e1c141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e1affd640 1 -- 172.21.15.87:0/3134044423 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c0b5f20 con 0x7f6e1c0ba020 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.411+0000 7f6e1b7fe640 1 --2- 172.21.15.87:0/3134044423 >> v2:172.21.15.110:3300/0 conn(0x7f6e1c14b2d0 0x7f6e1c141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.412+0000 7f6e1affd640 1 --2- 172.21.15.87:0/3134044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c0ba020 0x7f6e1c14ad90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0b4d10 tx=0x7f6e0c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf56d037dba83d5b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.412+0000 7f6e1a7fc640 1 -- 172.21.15.87:0/3134044423 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c037070 con 0x7f6e1c0ba020 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.412+0000 7f6e1a7fc640 1 -- 172.21.15.87:0/3134044423 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c032440 con 0x7f6e1c0ba020 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.412+0000 7f6e1a7fc640 1 -- 172.21.15.87:0/3134044423 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c032810 con 0x7f6e1c0ba020 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.413+0000 7f6e218b3640 1 -- 172.21.15.87:0/3134044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c0ba020 msgr2=0x7f6e1c14ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.413+0000 7f6e218b3640 1 --2- 172.21.15.87:0/3134044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c0ba020 0x7f6e1c14ad90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0b4d10 tx=0x7f6e0c02a1c0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.413+0000 7f6e218b3640 1 -- 172.21.15.87:0/3134044423 shutdown_connections 2024-05-09T08:02:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.413+0000 7f6e218b3640 1 --2- 172.21.15.87:0/3134044423 >> v2:172.21.15.110:3300/0 conn(0x7f6e1c14b2d0 0x7f6e1c141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.413+0000 7f6e218b3640 1 --2- 172.21.15.87:0/3134044423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c0ba020 0x7f6e1c14ad90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.413+0000 7f6e218b3640 1 -- 172.21.15.87:0/3134044423 >> 172.21.15.87:0/3134044423 conn(0x7f6e1c0671a0 msgr2=0x7f6e1c0675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.413+0000 7f6e218b3640 1 -- 172.21.15.87:0/3134044423 shutdown_connections 2024-05-09T08:02:17.431 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.413+0000 7f6e218b3640 1 -- 172.21.15.87:0/3134044423 wait complete. 2024-05-09T08:02:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.414+0000 7f6e218b3640 1 Processor -- start 2024-05-09T08:02:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.414+0000 7f6e218b3640 1 -- start start 2024-05-09T08:02:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.414+0000 7f6e218b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e1c0b9560 0x7f6e1c144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.414+0000 7f6e218b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e1c0ba020 0x7f6e1c148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.433 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.414+0000 7f6e218b3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c14b2d0 0x7f6e1c1e0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.414+0000 7f6e218b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c0b5400 con 0x7f6e1c0b9560 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.414+0000 7f6e218b3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c0b6c70 con 0x7f6e1c0ba020 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.414+0000 7f6e218b3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c0b5580 con 0x7f6e1c14b2d0 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e1c0b9560 0x7f6e1c144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1affd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e1c0b9560 0x7f6e1c144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47210/0 (socket says 172.21.15.87:47210) 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1affd640 1 -- 172.21.15.87:0/3083759670 learned_addr learned my addr 172.21.15.87:0/3083759670 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e127fc640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e1c0ba020 0x7f6e1c148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1b7fe640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c14b2d0 0x7f6e1c1e0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1affd640 1 -- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c14b2d0 msgr2=0x7f6e1c1e0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1affd640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e1c14b2d0 0x7f6e1c1e0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1affd640 1 -- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e1c0ba020 msgr2=0x7f6e1c148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1affd640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e1c0ba020 0x7f6e1c148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.434 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1affd640 1 -- 172.21.15.87:0/3083759670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c147970 con 0x7f6e1c0b9560 2024-05-09T08:02:17.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e1affd640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e1c0b9560 0x7f6e1c144560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c02a200 tx=0x7f6e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e18ff9640 1 -- 172.21.15.87:0/3083759670 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c037040 con 0x7f6e1c0b9560 2024-05-09T08:02:17.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e18ff9640 1 -- 172.21.15.87:0/3083759670 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c042070 con 0x7f6e1c0b9560 2024-05-09T08:02:17.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e18ff9640 1 -- 172.21.15.87:0/3083759670 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c030880 con 0x7f6e1c0b9560 2024-05-09T08:02:17.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1c146130 con 0x7f6e1c0b9560 2024-05-09T08:02:17.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.415+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1c145690 con 0x7f6e1c0b9560 2024-05-09T08:02:17.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.416+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e1c146370 con 0x7f6e1c0b9560 2024-05-09T08:02:17.435 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.417+0000 7f6e18ff9640 1 -- 172.21.15.87:0/3083759670 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e0c02ad10 con 0x7f6e1c0b9560 2024-05-09T08:02:17.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.417+0000 7f6e18ff9640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6dfc06be30 0x7f6dfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.436 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.417+0000 7f6e18ff9640 1 -- 172.21.15.87:0/3083759670 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f6e0c0ab3f0 con 0x7f6e1c0b9560 2024-05-09T08:02:17.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.417+0000 7f6e127fc640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6dfc06be30 0x7f6dfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.417+0000 7f6e18ff9640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7f6dfc074210 0x7f6dfc0766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.417+0000 7f6e18ff9640 1 -- 172.21.15.87:0/3083759670 --> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e0c001d30 con 0x7f6dfc074210 2024-05-09T08:02:17.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.417+0000 7f6e18ff9640 1 -- 172.21.15.87:0/3083759670 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6e0c0b2050 con 0x7f6e1c0b9560 2024-05-09T08:02:17.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.418+0000 7f6e127fc640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6dfc06be30 0x7f6dfc06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c143590 tx=0x7f6e04007cc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.418+0000 7f6e1b7fe640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7f6dfc074210 0x7f6dfc0766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.418+0000 7f6e1b7fe640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7f6dfc074210 0x7f6dfc0766b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.437 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.419+0000 7f6e18ff9640 1 -- 172.21.15.87:0/3083759670 <== osd.5 v2:172.21.15.110:6800/1937011744 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e0c001d30 con 0x7f6dfc074210 2024-05-09T08:02:17.448 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.432+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 --> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6e1c0691f0 con 0x7f6dfc074210 2024-05-09T08:02:17.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.432+0000 7f6e18ff9640 1 -- 172.21.15.87:0/3083759670 <== osd.5 v2:172.21.15.110:6800/1937011744 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6e1c0691f0 con 0x7f6dfc074210 2024-05-09T08:02:17.449 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:17.449 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T08:02:17.449 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:17.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7f6dfc074210 msgr2=0x7f6dfc0766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.110:6800/1937011744,v1:172.21.15.110:6801/1937011744] conn(0x7f6dfc074210 0x7f6dfc0766b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6dfc06be30 msgr2=0x7f6dfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f6dfc06be30 0x7f6dfc06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c143590 tx=0x7f6e04007cc0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e1c0b9560 msgr2=0x7f6e1c144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 --2- 172.21.15.87:0/3083759670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6e1c0b9560 0x7f6e1c144560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c02a200 tx=0x7f6e0c0046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e1b7fe640 1 -- 172.21.15.87:0/3083759670 reap_dead start 2024-05-09T08:02:17.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 shutdown_connections 2024-05-09T08:02:17.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 >> 172.21.15.87:0/3083759670 conn(0x7f6e1c0671a0 msgr2=0x7f6e1c0bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:17.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 shutdown_connections 2024-05-09T08:02:17.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.433+0000 7f6e218b3640 1 -- 172.21.15.87:0/3083759670 wait complete. 2024-05-09T08:02:17.460 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-09T08:02:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.546+0000 7f8114114640 1 Processor -- start 2024-05-09T08:02:17.563 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.546+0000 7f8114114640 1 -- start start 2024-05-09T08:02:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f8114114640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f810c144630 0x7f810c0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f8114114640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810c0b4640 con 0x7f810c0af130 2024-05-09T08:02:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f8114114640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810c0b0ca0 con 0x7f810c0b4260 2024-05-09T08:02:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f8114114640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f810c0af610 con 0x7f810c144630 2024-05-09T08:02:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f81126b1640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f810c144630 0x7f810c0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f81116af640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f810c0af130 0x7f810c0b26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59574/0 (socket says 172.21.15.87:59574) 2024-05-09T08:02:17.564 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f81116af640 1 -- 172.21.15.87:0/1628377992 learned_addr learned my addr 172.21.15.87:0/1628377992 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f81126b1640 1 -- 172.21.15.87:0/1628377992 >> v1:172.21.15.110:6789/0 conn(0x7f810c0b4260 legacy=0x7f810c143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f81126b1640 1 -- 172.21.15.87:0/1628377992 >> v1:172.21.15.87:6789/0 conn(0x7f810c0af130 legacy=0x7f810c0b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f81126b1640 1 -- 172.21.15.87:0/1628377992 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c0af8f0 con 0x7f810c144630 2024-05-09T08:02:17.565 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.547+0000 7f8110eae640 1 -- 172.21.15.87:0/1628377992 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311109273 0 0) 0x7f810c0b4640 con 0x7f810c0af130 2024-05-09T08:02:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.548+0000 7f81126b1640 1 --2- 172.21.15.87:0/1628377992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c144630 0x7f810c0b2df0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8104009d90 tx=0x7f810402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42728788d07751b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.548+0000 7f8110eae640 1 -- 172.21.15.87:0/1628377992 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104037070 con 0x7f810c144630 2024-05-09T08:02:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.548+0000 7f8110eae640 1 -- 172.21.15.87:0/1628377992 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8104007740 con 0x7f810c144630 2024-05-09T08:02:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.548+0000 7f8110eae640 1 -- 172.21.15.87:0/1628377992 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104007b10 con 0x7f810c144630 2024-05-09T08:02:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.549+0000 7f8114114640 1 -- 172.21.15.87:0/1628377992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c144630 msgr2=0x7f810c0b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.549+0000 7f8114114640 1 --2- 172.21.15.87:0/1628377992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c144630 0x7f810c0b2df0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8104009d90 tx=0x7f810402b7b0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.549+0000 7f8114114640 1 -- 172.21.15.87:0/1628377992 shutdown_connections 2024-05-09T08:02:17.566 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.549+0000 7f8114114640 1 --2- 172.21.15.87:0/1628377992 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c144630 0x7f810c0b2df0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.549+0000 7f8114114640 1 -- 172.21.15.87:0/1628377992 >> 172.21.15.87:0/1628377992 conn(0x7f810c0b5860 msgr2=0x7f810c0b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.549+0000 7f8114114640 1 -- 172.21.15.87:0/1628377992 shutdown_connections 2024-05-09T08:02:17.567 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.549+0000 7f8114114640 1 -- 172.21.15.87:0/1628377992 wait complete. 2024-05-09T08:02:17.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.550+0000 7f8114114640 1 Processor -- start 2024-05-09T08:02:17.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.550+0000 7f8114114640 1 -- start start 2024-05-09T08:02:17.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.550+0000 7f8114114640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c0af130 0x7f810c1cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.569 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.550+0000 7f8114114640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f810c0b4260 0x7f810c0709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.550+0000 7f8114114640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f810c144630 0x7f810c0b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.550+0000 7f8114114640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0b0660 con 0x7f810c0af130 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.550+0000 7f8114114640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0b04e0 con 0x7f810c0b4260 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.550+0000 7f8114114640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f810c0b3760 con 0x7f810c144630 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8111eb0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c0af130 0x7f810c1cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8111eb0640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c0af130 0x7f810c1cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47228/0 (socket says 172.21.15.87:47228) 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8111eb0640 1 -- 172.21.15.87:0/1598604049 learned_addr learned my addr 172.21.15.87:0/1598604049 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f81116af640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f810c0b4260 0x7f810c0709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f81126b1640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f810c144630 0x7f810c0b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8111eb0640 1 -- 172.21.15.87:0/1598604049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f810c144630 msgr2=0x7f810c0b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8111eb0640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f810c144630 0x7f810c0b8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8111eb0640 1 -- 172.21.15.87:0/1598604049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f810c0b4260 msgr2=0x7f810c0709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8111eb0640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f810c0b4260 0x7f810c0709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8111eb0640 1 -- 172.21.15.87:0/1598604049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c1cfe90 con 0x7f810c0af130 2024-05-09T08:02:17.570 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f81116af640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f810c0b4260 0x7f810c0709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:17.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8111eb0640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c0af130 0x7f810c1cf1c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f810800c460 tx=0x7f810800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f81027fc640 1 -- 172.21.15.87:0/1598604049 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108016020 con 0x7f810c0af130 2024-05-09T08:02:17.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f81027fc640 1 -- 172.21.15.87:0/1598604049 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8108012870 con 0x7f810c0af130 2024-05-09T08:02:17.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810c0714f0 con 0x7f810c0af130 2024-05-09T08:02:17.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f81027fc640 1 -- 172.21.15.87:0/1598604049 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108012c60 con 0x7f810c0af130 2024-05-09T08:02:17.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.551+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810c071c00 con 0x7f810c0af130 2024-05-09T08:02:17.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.552+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f810c0691f0 con 0x7f810c0af130 2024-05-09T08:02:17.571 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.553+0000 7f81027fc640 1 -- 172.21.15.87:0/1598604049 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8108019020 con 0x7f810c0af130 2024-05-09T08:02:17.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.553+0000 7f81027fc640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f80f006be30 0x7f80f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.553+0000 7f81116af640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f80f006be30 0x7f80f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.553+0000 7f81027fc640 1 -- 172.21.15.87:0/1598604049 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f810808a940 con 0x7f810c0af130 2024-05-09T08:02:17.572 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.554+0000 7f81116af640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f80f006be30 0x7f80f006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f810c1e1370 tx=0x7f80fc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.575 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.559+0000 7f81027fc640 1 -- 172.21.15.87:0/1598604049 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8108020070 con 0x7f810c0af130 2024-05-09T08:02:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.735+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f810c0b4890 con 0x7f80f006be30 2024-05-09T08:02:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.735+0000 7f81027fc640 1 -- 172.21.15.87:0/1598604049 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f810c0b4890 con 0x7f80f006be30 2024-05-09T08:02:17.752 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 5 to deep-scrub 2024-05-09T08:02:17.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.737+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f80f006be30 msgr2=0x7f80f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.754 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.737+0000 7f8114114640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f80f006be30 0x7f80f006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f810c1e1370 tx=0x7f80fc009040 comp rx=0 tx=0).stop 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.737+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c0af130 msgr2=0x7f810c1cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.737+0000 7f8114114640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c0af130 0x7f810c1cf1c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f810800c460 tx=0x7f810800c920 comp rx=0 tx=0).stop 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.738+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 shutdown_connections 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.738+0000 7f8114114640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f80f006be30 0x7f80f006e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.738+0000 7f8114114640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f810c144630 0x7f810c0b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.738+0000 7f8114114640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f810c0b4260 0x7f810c0709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.738+0000 7f8114114640 1 --2- 172.21.15.87:0/1598604049 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f810c0af130 0x7f810c1cf1c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.738+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 >> 172.21.15.87:0/1598604049 conn(0x7f810c0b5860 msgr2=0x7f810c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.738+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 shutdown_connections 2024-05-09T08:02:17.755 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.738+0000 7f8114114640 1 -- 172.21.15.87:0/1598604049 wait complete. 2024-05-09T08:02:17.766 INFO:tasks.ceph:Scrubbing osd.6 2024-05-09T08:02:17.766 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-09T08:02:17.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.853+0000 7fe74629e640 1 Processor -- start 2024-05-09T08:02:17.870 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.853+0000 7fe74629e640 1 -- start start 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe74629e640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7400af1b0 0x7fe7400b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe74629e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7400b4750 0x7fe74014e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe74629e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7400b3770 con 0x7fe7400af900 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe74629e640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fe7400b3d80 con 0x7fe7400af1b0 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe74629e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe7400b0ed0 con 0x7fe7400b4750 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe73f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7400af1b0 0x7fe7400b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe73f7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe7400af1b0 0x7fe7400b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47230/0 (socket says 172.21.15.87:47230) 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe73f7fe640 1 -- 172.21.15.87:0/3711882202 learned_addr learned my addr 172.21.15.87:0/3711882202 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe73f7fe640 1 -- 172.21.15.87:0/3711882202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7400b4750 msgr2=0x7fe74014e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe73f7fe640 1 --2- 172.21.15.87:0/3711882202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7400b4750 0x7fe74014e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe73f7fe640 1 -- 172.21.15.87:0/3711882202 >> v1:172.21.15.110:6789/0 conn(0x7fe7400af900 legacy=0x7fe7400b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:17.871 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.854+0000 7fe73f7fe640 1 -- 172.21.15.87:0/3711882202 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7400b4b80 con 0x7fe7400af1b0 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe73f7fe640 1 --2- 172.21.15.87:0/3711882202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400af1b0 0x7fe7400b4210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe7400b04e0 tx=0x7fe73402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7471d87bee851f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe73effd640 1 -- 172.21.15.87:0/3711882202 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734037070 con 0x7fe7400af1b0 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe73effd640 1 -- 172.21.15.87:0/3711882202 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73402ade0 con 0x7fe7400af1b0 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe73effd640 1 -- 172.21.15.87:0/3711882202 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734032660 con 0x7fe7400af1b0 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe74629e640 1 -- 172.21.15.87:0/3711882202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400af1b0 msgr2=0x7fe7400b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe74629e640 1 --2- 172.21.15.87:0/3711882202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400af1b0 0x7fe7400b4210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe7400b04e0 tx=0x7fe73402a0d0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe74629e640 1 -- 172.21.15.87:0/3711882202 shutdown_connections 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe74629e640 1 --2- 172.21.15.87:0/3711882202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7400b4750 0x7fe74014e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe74629e640 1 --2- 172.21.15.87:0/3711882202 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400af1b0 0x7fe7400b4210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe74629e640 1 -- 172.21.15.87:0/3711882202 >> 172.21.15.87:0/3711882202 conn(0x7fe74006c6a0 msgr2=0x7fe74006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:17.873 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe74629e640 1 -- 172.21.15.87:0/3711882202 shutdown_connections 2024-05-09T08:02:17.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.855+0000 7fe74629e640 1 -- 172.21.15.87:0/3711882202 wait complete. 2024-05-09T08:02:17.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.856+0000 7fe74629e640 1 Processor -- start 2024-05-09T08:02:17.874 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74629e640 1 -- start start 2024-05-09T08:02:17.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74629e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7400af1b0 0x7fe7400b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74629e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7400af900 0x7fe74009c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74629e640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400b4750 0x7fe74009abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74629e640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe7400afce0 con 0x7fe7400b4750 2024-05-09T08:02:17.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74629e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe7400b3a10 con 0x7fe7400af900 2024-05-09T08:02:17.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74629e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe7400ade30 con 0x7fe7400af1b0 2024-05-09T08:02:17.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74483b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400b4750 0x7fe74009abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.876 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74483b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400b4750 0x7fe74009abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47234/0 (socket says 172.21.15.87:47234) 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74483b640 1 -- 172.21.15.87:0/1351988718 learned_addr learned my addr 172.21.15.87:0/1351988718 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe73f7fe640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7400af900 0x7fe74009c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe73ffff640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7400af1b0 0x7fe7400b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74483b640 1 -- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7400af1b0 msgr2=0x7fe7400b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74483b640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7400af1b0 0x7fe7400b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74483b640 1 -- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7400af900 msgr2=0x7fe74009c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74483b640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7400af900 0x7fe74009c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.857+0000 7fe74483b640 1 -- 172.21.15.87:0/1351988718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe740071850 con 0x7fe7400b4750 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.858+0000 7fe73f7fe640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7400af900 0x7fe74009c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.858+0000 7fe73ffff640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7400af1b0 0x7fe7400b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.858+0000 7fe74483b640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400b4750 0x7fe74009abb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe73800b9a0 tx=0x7fe73800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.858+0000 7fe73cff9640 1 -- 172.21.15.87:0/1351988718 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738019070 con 0x7fe7400b4750 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.858+0000 7fe73cff9640 1 -- 172.21.15.87:0/1351988718 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73800cbc0 con 0x7fe7400b4750 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.858+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74009d3e0 con 0x7fe7400b4750 2024-05-09T08:02:17.877 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.858+0000 7fe73cff9640 1 -- 172.21.15.87:0/1351988718 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738014440 con 0x7fe7400b4750 2024-05-09T08:02:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.858+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74009c150 con 0x7fe7400b4750 2024-05-09T08:02:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.859+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7400691f0 con 0x7fe7400b4750 2024-05-09T08:02:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.859+0000 7fe73cff9640 1 -- 172.21.15.87:0/1351988718 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe73801c070 con 0x7fe7400b4750 2024-05-09T08:02:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.860+0000 7fe73cff9640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe72c06be30 0x7fe72c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.860+0000 7fe73cff9640 1 -- 172.21.15.87:0/1351988718 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe73808abb0 con 0x7fe7400b4750 2024-05-09T08:02:17.878 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.860+0000 7fe73ffff640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe72c06be30 0x7fe72c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.860+0000 7fe73cff9640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7fe72c0741b0 0x7fe72c076650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.860+0000 7fe73cff9640 1 -- 172.21.15.87:0/1351988718 --> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe72c076d20 con 0x7fe72c0741b0 2024-05-09T08:02:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.860+0000 7fe73cff9640 1 -- 172.21.15.87:0/1351988718 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe73808f2c0 con 0x7fe7400b4750 2024-05-09T08:02:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.860+0000 7fe73ffff640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe72c06be30 0x7fe72c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe730007fd0 tx=0x7fe730009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.860+0000 7fe73f7fe640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7fe72c0741b0 0x7fe72c076650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.861+0000 7fe73f7fe640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7fe72c0741b0 0x7fe72c076650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:17.879 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.861+0000 7fe73cff9640 1 -- 172.21.15.87:0/1351988718 <== osd.6 v2:172.21.15.110:6808/1772840831 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe72c076d20 con 0x7fe72c0741b0 2024-05-09T08:02:17.890 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.874+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 --> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe74009d190 con 0x7fe72c0741b0 2024-05-09T08:02:17.891 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe73cff9640 1 -- 172.21.15.87:0/1351988718 <== osd.6 v2:172.21.15.110:6808/1772840831 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe74009d190 con 0x7fe72c0741b0 2024-05-09T08:02:17.891 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:17.892 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T08:02:17.892 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:17.892 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7fe72c0741b0 msgr2=0x7fe72c076650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.110:6808/1772840831,v1:172.21.15.110:6809/1772840831] conn(0x7fe72c0741b0 0x7fe72c076650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe72c06be30 msgr2=0x7fe72c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe72c06be30 0x7fe72c06e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe730007fd0 tx=0x7fe730009040 comp rx=0 tx=0).stop 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400b4750 msgr2=0x7fe74009abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 --2- 172.21.15.87:0/1351988718 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7400b4750 0x7fe74009abb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe73800b9a0 tx=0x7fe73800be60 comp rx=0 tx=0).stop 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74483b640 1 -- 172.21.15.87:0/1351988718 reap_dead start 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 shutdown_connections 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 >> 172.21.15.87:0/1351988718 conn(0x7fe74006c6a0 msgr2=0x7fe7400b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 shutdown_connections 2024-05-09T08:02:17.893 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.875+0000 7fe74629e640 1 -- 172.21.15.87:0/1351988718 wait complete. 2024-05-09T08:02:17.903 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-09T08:02:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.986+0000 7fc66ccd4640 1 Processor -- start 2024-05-09T08:02:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.986+0000 7fc66ccd4640 1 -- start start 2024-05-09T08:02:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc66ccd4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6680b4dd0 0x7fc6680b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc66ccd4640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc668141ec0 0x7fc668147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc66ccd4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6680b4780 con 0x7fc6680b56f0 2024-05-09T08:02:18.004 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc66ccd4640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fc6680b6090 con 0x7fc668141ec0 2024-05-09T08:02:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc66ccd4640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fc6680b6370 con 0x7fc6680b4dd0 2024-05-09T08:02:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc666d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc668141ec0 0x7fc668147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc666d9d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc668141ec0 0x7fc668147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47236/0 (socket says 172.21.15.87:47236) 2024-05-09T08:02:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc666d9d640 1 -- 172.21.15.87:0/2880401856 learned_addr learned my addr 172.21.15.87:0/2880401856 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc66659c640 1 --2- 172.21.15.87:0/2880401856 >> v2:172.21.15.110:3300/0 conn(0x7fc6680b4dd0 0x7fc6680b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc666d9d640 1 -- 172.21.15.87:0/2880401856 >> v2:172.21.15.110:3300/0 conn(0x7fc6680b4dd0 msgr2=0x7fc6680b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc666d9d640 1 --2- 172.21.15.87:0/2880401856 >> v2:172.21.15.110:3300/0 conn(0x7fc6680b4dd0 0x7fc6680b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc666d9d640 1 -- 172.21.15.87:0/2880401856 >> v1:172.21.15.110:6789/0 conn(0x7fc6680b56f0 legacy=0x7fc6681417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:18.005 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.987+0000 7fc666d9d640 1 -- 172.21.15.87:0/2880401856 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6680b5e20 con 0x7fc668141ec0 2024-05-09T08:02:18.008 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.988+0000 7fc666d9d640 1 --2- 172.21.15.87:0/2880401856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc668141ec0 0x7fc668147cf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc6680be0c0 tx=0x7fc66002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c334bc4c69bcfa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.988+0000 7fc66559a640 1 -- 172.21.15.87:0/2880401856 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660036070 con 0x7fc668141ec0 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.988+0000 7fc66559a640 1 -- 172.21.15.87:0/2880401856 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc660031600 con 0x7fc668141ec0 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.988+0000 7fc66559a640 1 -- 172.21.15.87:0/2880401856 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6600319d0 con 0x7fc668141ec0 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.989+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2880401856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc668141ec0 msgr2=0x7fc668147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.989+0000 7fc66ccd4640 1 --2- 172.21.15.87:0/2880401856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc668141ec0 0x7fc668147cf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc6680be0c0 tx=0x7fc66002a660 comp rx=0 tx=0).stop 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.989+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2880401856 shutdown_connections 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.989+0000 7fc66ccd4640 1 --2- 172.21.15.87:0/2880401856 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc668141ec0 0x7fc668147cf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.989+0000 7fc66ccd4640 1 --2- 172.21.15.87:0/2880401856 >> v2:172.21.15.110:3300/0 conn(0x7fc6680b4dd0 0x7fc6680b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.989+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2880401856 >> 172.21.15.87:0/2880401856 conn(0x7fc6680677b0 msgr2=0x7fc6680bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.989+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2880401856 shutdown_connections 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.989+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2880401856 wait complete. 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.990+0000 7fc66ccd4640 1 Processor -- start 2024-05-09T08:02:18.009 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.990+0000 7fc66ccd4640 1 -- start start 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.990+0000 7fc66ccd4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6680b4dd0 0x7fc66814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc66ccd4640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6680b56f0 0x7fc6681425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc66ccd4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc668141ec0 0x7fc6681e1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc66ccd4640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fc6681483b0 con 0x7fc6680b56f0 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc66ccd4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc668148230 con 0x7fc668141ec0 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc66ccd4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fc668148530 con 0x7fc6680b4dd0 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc665d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6680b56f0 0x7fc6681425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc665d9b640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6680b56f0 0x7fc6681425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47244/0 (socket says 172.21.15.87:47244) 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc665d9b640 1 -- 172.21.15.87:0/2549569332 learned_addr learned my addr 172.21.15.87:0/2549569332 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc666d9d640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc668141ec0 0x7fc6681e1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc66659c640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6680b4dd0 0x7fc66814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc665d9b640 1 -- 172.21.15.87:0/2549569332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6680b4dd0 msgr2=0x7fc66814b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc665d9b640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6680b4dd0 0x7fc66814b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.010 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc665d9b640 1 -- 172.21.15.87:0/2549569332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc668141ec0 msgr2=0x7fc6681e1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc665d9b640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc668141ec0 0x7fc6681e1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc665d9b640 1 -- 172.21.15.87:0/2549569332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc668142db0 con 0x7fc6680b56f0 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc666d9d640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc668141ec0 0x7fc6681e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc665d9b640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6680b56f0 0x7fc6681425d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00c430 tx=0x7fc65c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc656ffd640 1 -- 172.21.15.87:0/2549569332 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c011790 con 0x7fc6680b56f0 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc656ffd640 1 -- 172.21.15.87:0/2549569332 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65c017070 con 0x7fc6680b56f0 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc668143090 con 0x7fc6680b56f0 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc656ffd640 1 -- 172.21.15.87:0/2549569332 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c011bb0 con 0x7fc6680b56f0 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.991+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc668144200 con 0x7fc6680b56f0 2024-05-09T08:02:18.011 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.992+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6680b76f0 con 0x7fc6680b56f0 2024-05-09T08:02:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.993+0000 7fc656ffd640 1 -- 172.21.15.87:0/2549569332 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc65c01c460 con 0x7fc6680b56f0 2024-05-09T08:02:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.993+0000 7fc656ffd640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc64806be60 0x7fc64806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.993+0000 7fc656ffd640 1 -- 172.21.15.87:0/2549569332 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fc65c08ace0 con 0x7fc6680b56f0 2024-05-09T08:02:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.993+0000 7fc66659c640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc64806be60 0x7fc64806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.012 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.994+0000 7fc66659c640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc64806be60 0x7fc64806e320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc658006fd0 tx=0x7fc658008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.014 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:17.997+0000 7fc656ffd640 1 -- 172.21.15.87:0/2549569332 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc6680b76f0 con 0x7fc6680b56f0 2024-05-09T08:02:18.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.174+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fc6680b3df0 con 0x7fc64806be60 2024-05-09T08:02:18.191 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.174+0000 7fc656ffd640 1 -- 172.21.15.87:0/2549569332 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc6680b3df0 con 0x7fc64806be60 2024-05-09T08:02:18.191 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 6 to deep-scrub 2024-05-09T08:02:18.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc64806be60 msgr2=0x7fc64806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc64806be60 0x7fc64806e320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc658006fd0 tx=0x7fc658008040 comp rx=0 tx=0).stop 2024-05-09T08:02:18.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6680b56f0 msgr2=0x7fc6681425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6680b56f0 0x7fc6681425d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00c430 tx=0x7fc65c00c8f0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.193 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 shutdown_connections 2024-05-09T08:02:18.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fc64806be60 0x7fc64806e320 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc668141ec0 0x7fc6681e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6680b56f0 0x7fc6681425d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 --2- 172.21.15.87:0/2549569332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6680b4dd0 0x7fc66814b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 >> 172.21.15.87:0/2549569332 conn(0x7fc6680677b0 msgr2=0x7fc668141580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:18.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 shutdown_connections 2024-05-09T08:02:18.194 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.176+0000 7fc66ccd4640 1 -- 172.21.15.87:0/2549569332 wait complete. 2024-05-09T08:02:18.204 INFO:tasks.ceph:Scrubbing osd.7 2024-05-09T08:02:18.204 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-09T08:02:18.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.291+0000 7ff226961640 1 Processor -- start 2024-05-09T08:02:18.307 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.291+0000 7ff226961640 1 -- start start 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.291+0000 7ff226961640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2200b5e60 0x7ff2200b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.291+0000 7ff226961640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2200b6240 con 0x7ff2200b2940 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.291+0000 7ff226961640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2200b1860 con 0x7ff2200b5330 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.291+0000 7ff226961640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff2200b0470 con 0x7ff2200b5e60 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.291+0000 7ff224efe640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff2200b2940 0x7ff220147bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59590/0 (socket says 172.21.15.87:59590) 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.291+0000 7ff224efe640 1 -- 172.21.15.87:0/3377868967 learned_addr learned my addr 172.21.15.87:0/3377868967 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837204127 0 0) 0x7ff2200b6240 con 0x7ff2200b2940 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff208003520 con 0x7ff2200b2940 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21ffff640 1 --2- 172.21.15.87:0/3377868967 >> v2:172.21.15.110:3300/0 conn(0x7ff2200b5e60 0x7ff2200b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 6544413 0 0) 0x7ff208003520 con 0x7ff2200b2940 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 >> v2:172.21.15.110:3300/0 conn(0x7ff2200b5e60 msgr2=0x7ff2200b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:18.311 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 --2- 172.21.15.87:0/3377868967 >> v2:172.21.15.110:3300/0 conn(0x7ff2200b5e60 0x7ff2200b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 >> v1:172.21.15.110:6789/0 conn(0x7ff2200b5330 legacy=0x7ff2200b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2200afd40 con 0x7ff2200b2940 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7ff2180019f0 con 0x7ff2200b2940 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 >> v1:172.21.15.87:6789/0 conn(0x7ff2200b2940 legacy=0x7ff220147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff208003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff208004800 0x7ff208004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2080051c0 0x7ff20800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff20800c130 con 0x7ff2080039b0 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff20800c2e0 con 0x7ff208004800 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff20800c4e0 con 0x7ff2080051c0 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21ffff640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff208003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21f7fe640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff208004800 0x7ff208004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff224efe640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2080051c0 0x7ff20800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21ffff640 1 -- 172.21.15.87:0/3377868967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2080051c0 msgr2=0x7ff20800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:18.312 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21ffff640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2080051c0 0x7ff20800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21ffff640 1 -- 172.21.15.87:0/3377868967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff208004800 msgr2=0x7ff208004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21ffff640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff208004800 0x7ff208004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff21ffff640 1 -- 172.21.15.87:0/3377868967 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff208003520 con 0x7ff2080039b0 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.292+0000 7ff224efe640 1 -- 172.21.15.87:0/3377868967 reap_dead start 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.293+0000 7ff21ffff640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff208003dd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff210009ac0 tx=0x7ff208005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7503da9ace9a56 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.293+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff210036070 con 0x7ff2080039b0 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.293+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff210031400 con 0x7ff2080039b0 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.293+0000 7ff21effd640 1 -- 172.21.15.87:0/3377868967 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff210009690 con 0x7ff2080039b0 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.294+0000 7ff226961640 1 -- 172.21.15.87:0/3377868967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 msgr2=0x7ff208003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.294+0000 7ff226961640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff208003dd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff210009ac0 tx=0x7ff208005830 comp rx=0 tx=0).stop 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.294+0000 7ff226961640 1 -- 172.21.15.87:0/3377868967 shutdown_connections 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.294+0000 7ff226961640 1 --2- 172.21.15.87:0/3377868967 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff208003dd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.294+0000 7ff226961640 1 -- 172.21.15.87:0/3377868967 >> 172.21.15.87:0/3377868967 conn(0x7ff22006c6a0 msgr2=0x7ff22006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:18.313 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.294+0000 7ff226961640 1 -- 172.21.15.87:0/3377868967 shutdown_connections 2024-05-09T08:02:18.314 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.294+0000 7ff226961640 1 -- 172.21.15.87:0/3377868967 wait complete. 2024-05-09T08:02:18.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.295+0000 7ff226961640 1 Processor -- start 2024-05-09T08:02:18.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.295+0000 7ff226961640 1 -- start start 2024-05-09T08:02:18.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.295+0000 7ff226961640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff2201db040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.295+0000 7ff226961640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2201c28a0 0x7ff2201c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.295+0000 7ff226961640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2201c0da0 0x7ff2201c1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.295+0000 7ff226961640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff2200b1cf0 con 0x7ff2080039b0 2024-05-09T08:02:18.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff226961640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff2200b1580 con 0x7ff2201c0da0 2024-05-09T08:02:18.317 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff226961640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff2200b1e70 con 0x7ff2201c28a0 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff2201db040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff2201db040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47266/0 (socket says 172.21.15.87:47266) 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21ffff640 1 -- 172.21.15.87:0/1768137809 learned_addr learned my addr 172.21.15.87:0/1768137809 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff224efe640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2201c0da0 0x7ff2201c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21f7fe640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2201c28a0 0x7ff2201c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21ffff640 1 -- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2201c28a0 msgr2=0x7ff2201c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21ffff640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2201c28a0 0x7ff2201c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21ffff640 1 -- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2201c0da0 msgr2=0x7ff2201c1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21ffff640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2201c0da0 0x7ff2201c1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21ffff640 1 -- 172.21.15.87:0/1768137809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2201c3240 con 0x7ff2080039b0 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21f7fe640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2201c28a0 0x7ff2201c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21ffff640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff2201db040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff210034040 tx=0x7ff210004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21cff9640 1 -- 172.21.15.87:0/1768137809 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21003f020 con 0x7ff2080039b0 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21cff9640 1 -- 172.21.15.87:0/1768137809 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff210037040 con 0x7ff2080039b0 2024-05-09T08:02:18.318 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2201c6f40 con 0x7ff2080039b0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff21cff9640 1 -- 172.21.15.87:0/1768137809 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff210036070 con 0x7ff2080039b0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.296+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2201dba40 con 0x7ff2080039b0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.297+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2201c4e40 con 0x7ff2080039b0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.298+0000 7ff21cff9640 1 -- 172.21.15.87:0/1768137809 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff210042020 con 0x7ff2080039b0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.298+0000 7ff21cff9640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff20c06be30 0x7ff20c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.298+0000 7ff21cff9640 1 -- 172.21.15.87:0/1768137809 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ff2100aada0 con 0x7ff2080039b0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.298+0000 7ff21f7fe640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff20c06be30 0x7ff20c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.298+0000 7ff21cff9640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7ff20c0741b0 0x7ff20c076650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.298+0000 7ff21cff9640 1 -- 172.21.15.87:0/1768137809 --> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff20c076d20 con 0x7ff20c0741b0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.298+0000 7ff21cff9640 1 -- 172.21.15.87:0/1768137809 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff2100ad4a0 con 0x7ff2080039b0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.298+0000 7ff21f7fe640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff20c06be30 0x7ff20c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff214000c00 tx=0x7ff214009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.298+0000 7ff224efe640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7ff20c0741b0 0x7ff20c076650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.299+0000 7ff224efe640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7ff20c0741b0 0x7ff20c076650 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.319 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.300+0000 7ff21cff9640 1 -- 172.21.15.87:0/1768137809 <== osd.7 v2:172.21.15.110:6816/628113560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff20c076d20 con 0x7ff20c0741b0 2024-05-09T08:02:18.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.312+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 --> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff2201db580 con 0x7ff20c0741b0 2024-05-09T08:02:18.329 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff21cff9640 1 -- 172.21.15.87:0/1768137809 <== osd.7 v2:172.21.15.110:6816/628113560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff2201db580 con 0x7ff20c0741b0 2024-05-09T08:02:18.330 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-05-09T08:02:18.330 INFO:teuthology.orchestra.run.smithi087.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T08:02:18.330 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7ff20c0741b0 msgr2=0x7ff20c076650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.110:6816/628113560,v1:172.21.15.110:6817/628113560] conn(0x7ff20c0741b0 0x7ff20c076650 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff20c06be30 msgr2=0x7ff20c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff20c06be30 0x7ff20c06e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff214000c00 tx=0x7ff214009040 comp rx=0 tx=0).stop 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 msgr2=0x7ff2201db040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 --2- 172.21.15.87:0/1768137809 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2080039b0 0x7ff2201db040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff210034040 tx=0x7ff210004730 comp rx=0 tx=0).stop 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff224efe640 1 -- 172.21.15.87:0/1768137809 reap_dead start 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 shutdown_connections 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 >> 172.21.15.87:0/1768137809 conn(0x7ff22006c6a0 msgr2=0x7ff22006fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 shutdown_connections 2024-05-09T08:02:18.331 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.313+0000 7ff226961640 1 -- 172.21.15.87:0/1768137809 wait complete. 2024-05-09T08:02:18.341 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-09T08:02:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.425+0000 7ff401141640 1 Processor -- start 2024-05-09T08:02:18.442 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.425+0000 7ff401141640 1 -- start start 2024-05-09T08:02:18.444 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff401141640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc0ae490 0x7ff3fc146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff401141640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3fc0b15a0 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff401141640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3fc0b3db0 con 0x7ff3fc147100 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff401141640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff3fc0af940 con 0x7ff3fc0ae490 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3fad9d640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff3fc0b39d0 0x7ff3fc0add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59592/0 (socket says 172.21.15.87:59592) 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3fad9d640 1 -- 172.21.15.87:0/997537067 learned_addr learned my addr 172.21.15.87:0/997537067 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3fa59c640 1 --2- 172.21.15.87:0/997537067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc0ae490 0x7ff3fc146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3f9d9b640 1 -- 172.21.15.87:0/997537067 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691785550 0 0) 0x7ff3fc0b15a0 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3f9d9b640 1 -- 172.21.15.87:0/997537067 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3e4003520 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3f9d9b640 1 -- 172.21.15.87:0/997537067 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2989137740 0 0) 0x7ff3fc0b3db0 con 0x7ff3fc147100 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3f9d9b640 1 -- 172.21.15.87:0/997537067 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3fc0b15a0 con 0x7ff3fc147100 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3fa59c640 1 -- 172.21.15.87:0/997537067 >> v1:172.21.15.110:6789/0 conn(0x7ff3fc147100 legacy=0x7ff3fc14f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3fa59c640 1 -- 172.21.15.87:0/997537067 >> v1:172.21.15.87:6789/0 conn(0x7ff3fc0b39d0 legacy=0x7ff3fc0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.445 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3f9d9b640 1 -- 172.21.15.87:0/997537067 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3914280501 0 0) 0x7ff3e4003520 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.426+0000 7ff3fa59c640 1 -- 172.21.15.87:0/997537067 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc0afd90 con 0x7ff3fc0ae490 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.427+0000 7ff3fa59c640 1 --2- 172.21.15.87:0/997537067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc0ae490 0x7ff3fc146bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00097d0 tx=0x7ff3f002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4983efa1c66e9e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.427+0000 7ff3f9d9b640 1 -- 172.21.15.87:0/997537067 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0037070 con 0x7ff3fc0ae490 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.427+0000 7ff3f9d9b640 1 -- 172.21.15.87:0/997537067 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f002ab90 con 0x7ff3fc0ae490 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.427+0000 7ff3f9d9b640 1 -- 172.21.15.87:0/997537067 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec001670 con 0x7ff3fc0ae490 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.428+0000 7ff401141640 1 -- 172.21.15.87:0/997537067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc0ae490 msgr2=0x7ff3fc146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.428+0000 7ff401141640 1 --2- 172.21.15.87:0/997537067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc0ae490 0x7ff3fc146bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00097d0 tx=0x7ff3f002a100 comp rx=0 tx=0).stop 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.428+0000 7ff401141640 1 -- 172.21.15.87:0/997537067 shutdown_connections 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.428+0000 7ff401141640 1 --2- 172.21.15.87:0/997537067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc0ae490 0x7ff3fc146bc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.428+0000 7ff401141640 1 -- 172.21.15.87:0/997537067 >> 172.21.15.87:0/997537067 conn(0x7ff3fc0b5860 msgr2=0x7ff3fc0b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.428+0000 7ff401141640 1 -- 172.21.15.87:0/997537067 shutdown_connections 2024-05-09T08:02:18.446 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.428+0000 7ff401141640 1 -- 172.21.15.87:0/997537067 wait complete. 2024-05-09T08:02:18.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.429+0000 7ff401141640 1 Processor -- start 2024-05-09T08:02:18.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.429+0000 7ff401141640 1 -- start start 2024-05-09T08:02:18.449 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.429+0000 7ff401141640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0ae490 0x7ff3fc1e0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.429+0000 7ff401141640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3fc0b39d0 0x7ff3fc1d1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.429+0000 7ff401141640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc147100 0x7ff3fc1d1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.429+0000 7ff401141640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc06d9b0 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.429+0000 7ff401141640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc06d830 con 0x7ff3fc0ae490 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.429+0000 7ff401141640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff3fc1475b0 con 0x7ff3fc147100 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3fc0b39d0 0x7ff3fc1d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3fc0b39d0 0x7ff3fc1d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47280/0 (socket says 172.21.15.87:47280) 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fa59c640 1 -- 172.21.15.87:0/2387090313 learned_addr learned my addr 172.21.15.87:0/2387090313 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fad9d640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0ae490 0x7ff3fc1e0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fb59e640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc147100 0x7ff3fc1d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fa59c640 1 -- 172.21.15.87:0/2387090313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc147100 msgr2=0x7ff3fc1d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fa59c640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc147100 0x7ff3fc1d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fa59c640 1 -- 172.21.15.87:0/2387090313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0ae490 msgr2=0x7ff3fc1e0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.450 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fa59c640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0ae490 0x7ff3fc1e0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fa59c640 1 -- 172.21.15.87:0/2387090313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc1e0f00 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fad9d640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0ae490 0x7ff3fc1e0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3fa59c640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3fc0b39d0 0x7ff3fc1d1010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00097d0 tx=0x7ff3f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3e37fe640 1 -- 172.21.15.87:0/2387090313 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0037050 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3e37fe640 1 -- 172.21.15.87:0/2387090313 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f0038040 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc09cd60 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff3e37fe640 1 -- 172.21.15.87:0/2387090313 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0006e10 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.430+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc09c0e0 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.431+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc0b4e60 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.432+0000 7ff3e37fe640 1 -- 172.21.15.87:0/2387090313 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3f0045020 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.432+0000 7ff3e37fe640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff3e806be30 0x7ff3e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.432+0000 7ff3e37fe640 1 -- 172.21.15.87:0/2387090313 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ff3f00aae80 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.432+0000 7ff3fad9d640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff3e806be30 0x7ff3e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.451 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.433+0000 7ff3fad9d640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff3e806be30 0x7ff3e806e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0017e0 tx=0x7ff3ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.453 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.436+0000 7ff3e37fe640 1 -- 172.21.15.87:0/2387090313 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff3f004c020 con 0x7ff3fc0b39d0 2024-05-09T08:02:18.628 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.611+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff3fc1e13e0 con 0x7ff3e806be30 2024-05-09T08:02:18.629 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.612+0000 7ff3e37fe640 1 -- 172.21.15.87:0/2387090313 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff3fc1e13e0 con 0x7ff3e806be30 2024-05-09T08:02:18.629 INFO:teuthology.orchestra.run.smithi087.stderr:instructed osd(s) 7 to deep-scrub 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff3e806be30 msgr2=0x7ff3e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff3e806be30 0x7ff3e806e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0017e0 tx=0x7ff3ec009040 comp rx=0 tx=0).stop 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3fc0b39d0 msgr2=0x7ff3fc1d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3fc0b39d0 0x7ff3fc1d1010 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00097d0 tx=0x7ff3f00046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 shutdown_connections 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff3e806be30 0x7ff3e806e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3fc147100 0x7ff3fc1d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff3fc0b39d0 0x7ff3fc1d1010 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 --2- 172.21.15.87:0/2387090313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3fc0ae490 0x7ff3fc1e0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 >> 172.21.15.87:0/2387090313 conn(0x7ff3fc0b5860 msgr2=0x7ff3fc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 shutdown_connections 2024-05-09T08:02:18.631 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.614+0000 7ff401141640 1 -- 172.21.15.87:0/2387090313 wait complete. 2024-05-09T08:02:18.642 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T08:02:18.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.725+0000 7ff9b08ca640 1 Processor -- start 2024-05-09T08:02:18.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.725+0000 7ff9b08ca640 1 -- start start 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.725+0000 7ff9b08ca640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac0af1b0 0x7ff9ac0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.725+0000 7ff9b08ca640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9ac0b4750 0x7ff9ac14e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.725+0000 7ff9b08ca640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac0b3770 con 0x7ff9ac0af900 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.725+0000 7ff9b08ca640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ac0b3d80 con 0x7ff9ac0b4750 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.725+0000 7ff9b08ca640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b0ed0 con 0x7ff9ac0af1b0 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9aa59c640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff9ac0af900 0x7ff9ac0b28e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:59604/0 (socket says 172.21.15.87:59604) 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9aa59c640 1 -- 172.21.15.87:0/2021163480 learned_addr learned my addr 172.21.15.87:0/2021163480 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9aad9d640 1 --2- 172.21.15.87:0/2021163480 >> v2:172.21.15.110:3300/0 conn(0x7ff9ac0b4750 0x7ff9ac14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a1d9b640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac0af1b0 0x7ff9ac0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.745 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3175597337 0 0) 0x7ff9ac0b3770 con 0x7ff9ac0af900 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff998003520 con 0x7ff9ac0af900 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1068761421 0 0) 0x7ff998003520 con 0x7ff9ac0af900 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac0af1b0 msgr2=0x7ff9ac0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac0af1b0 0x7ff9ac0b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 >> v2:172.21.15.110:3300/0 conn(0x7ff9ac0b4750 msgr2=0x7ff9ac14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 --2- 172.21.15.87:0/2021163480 >> v2:172.21.15.110:3300/0 conn(0x7ff9ac0b4750 0x7ff9ac14e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0b4ba0 con 0x7ff9ac0af900 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7ff99c001690 con 0x7ff9ac0af900 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 >> v1:172.21.15.87:6789/0 conn(0x7ff9ac0af900 legacy=0x7ff9ac0b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac0af1b0 0x7ff9980039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff998003f30 0x7ff998004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b3d80 con 0x7ff998004d40 2024-05-09T08:02:18.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b0ed0 con 0x7ff998003f30 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff99800baa0 con 0x7ff9ac0af1b0 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9aad9d640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9aa59c640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac0af1b0 0x7ff9980039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.726+0000 7ff9a1d9b640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff998003f30 0x7ff998004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.727+0000 7ff9aad9d640 1 -- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac0af1b0 msgr2=0x7ff9980039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.727+0000 7ff9aad9d640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac0af1b0 0x7ff9980039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.727+0000 7ff9aad9d640 1 -- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff998003f30 msgr2=0x7ff998004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.727+0000 7ff9aad9d640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff998003f30 0x7ff998004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.727+0000 7ff9aad9d640 1 -- 172.21.15.87:0/2021163480 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff998003520 con 0x7ff998004d40 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.727+0000 7ff9aad9d640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9980051c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009fc0 tx=0x7ff998005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6632d4b38d8b0776 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.727+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4009c10 con 0x7ff998004d40 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.727+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a402e640 con 0x7ff998004d40 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.727+0000 7ff9a9d9b640 1 -- 172.21.15.87:0/2021163480 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a402ea30 con 0x7ff998004d40 2024-05-09T08:02:18.747 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.728+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2021163480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 msgr2=0x7ff9980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.728+0000 7ff9b08ca640 1 --2- 172.21.15.87:0/2021163480 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9980051c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009fc0 tx=0x7ff998005830 comp rx=0 tx=0).stop 2024-05-09T08:02:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.728+0000 7ff9aad9d640 1 -- 172.21.15.87:0/2021163480 reap_dead start 2024-05-09T08:02:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.728+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2021163480 shutdown_connections 2024-05-09T08:02:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.728+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2021163480 >> 172.21.15.87:0/2021163480 conn(0x7ff9ac06c6a0 msgr2=0x7ff9ac06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.728+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2021163480 shutdown_connections 2024-05-09T08:02:18.748 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.728+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2021163480 wait complete. 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.729+0000 7ff9b08ca640 1 Processor -- start 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.729+0000 7ff9b08ca640 1 -- start start 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9b08ca640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9ac0b95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9b08ca640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ac06f7f0 0x7ff9ac06fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9b08ca640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac1d8db0 0x7ff9ac1d9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9b08ca640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0afce0 con 0x7ff998004d40 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9b08ca640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b3a10 con 0x7ff9ac06f7f0 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9b08ca640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0ade30 con 0x7ff9ac1d8db0 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9ac0b95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aa59c640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9ac0b95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:47300/0 (socket says 172.21.15.87:47300) 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aa59c640 1 -- 172.21.15.87:0/2057678847 learned_addr learned my addr 172.21.15.87:0/2057678847 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:18.751 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9a1d9b640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ac06f7f0 0x7ff9ac06fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aad9d640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac1d8db0 0x7ff9ac1d9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aa59c640 1 -- 172.21.15.87:0/2057678847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac1d8db0 msgr2=0x7ff9ac1d9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aa59c640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac1d8db0 0x7ff9ac1d9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aa59c640 1 -- 172.21.15.87:0/2057678847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ac06f7f0 msgr2=0x7ff9ac06fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aa59c640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ac06f7f0 0x7ff9ac06fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aa59c640 1 -- 172.21.15.87:0/2057678847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac1d9770 con 0x7ff998004d40 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9a1d9b640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ac06f7f0 0x7ff9ac06fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9aa59c640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9ac0b95a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff99c007310 tx=0x7ff99c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9a37fe640 1 -- 172.21.15.87:0/2057678847 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00f990 con 0x7ff998004d40 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9a37fe640 1 -- 172.21.15.87:0/2057678847 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c018070 con 0x7ff998004d40 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac141320 con 0x7ff998004d40 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9a37fe640 1 -- 172.21.15.87:0/2057678847 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00fd90 con 0x7ff998004d40 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.730+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac1415c0 con 0x7ff998004d40 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.731+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac0691f0 con 0x7ff998004d40 2024-05-09T08:02:18.752 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.732+0000 7ff9a37fe640 1 -- 172.21.15.87:0/2057678847 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff99c01d460 con 0x7ff998004d40 2024-05-09T08:02:18.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.732+0000 7ff9a37fe640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff98c06be30 0x7ff98c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:18.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.732+0000 7ff9a37fe640 1 -- 172.21.15.87:0/2057678847 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7ff99c08afe0 con 0x7ff998004d40 2024-05-09T08:02:18.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.732+0000 7ff9a1d9b640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff98c06be30 0x7ff98c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:18.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.733+0000 7ff9a1d9b640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff98c06be30 0x7ff98c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac1442d0 tx=0x7ff994008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:18.753 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.737+0000 7ff9a37fe640 1 -- 172.21.15.87:0/2057678847 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ff9ac1d9770 con 0x7ff998004d40 2024-05-09T08:02:18.923 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.906+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9ac1d8a30 con 0x7ff98c06be30 2024-05-09T08:02:18.928 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.912+0000 7ff9a37fe640 1 -- 172.21.15.87:0/2057678847 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253468 (secure 0 0 0) 0x7ff9ac1d8a30 con 0x7ff98c06be30 2024-05-09T08:02:18.932 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:18.933 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff98c06be30 msgr2=0x7ff98c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff98c06be30 0x7ff98c06e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac1442d0 tx=0x7ff994008040 comp rx=0 tx=0).stop 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 msgr2=0x7ff9ac0b95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9ac0b95a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff99c007310 tx=0x7ff99c0077d0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 shutdown_connections 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7ff98c06be30 0x7ff98c06e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9ac1d8db0 0x7ff9ac1d9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9ac06f7f0 0x7ff9ac06fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 --2- 172.21.15.87:0/2057678847 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff998004d40 0x7ff9ac0b95a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 >> 172.21.15.87:0/2057678847 conn(0x7ff9ac06c6a0 msgr2=0x7ff9ac074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 shutdown_connections 2024-05-09T08:02:18.935 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:18.915+0000 7ff9b08ca640 1 -- 172.21.15.87:0/2057678847 wait complete. 2024-05-09T08:02:18.943 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-05-09T08:02:16.985861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":150898066,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1422,"num_read_kb":2045,"num_write":66424,"num_write_kb":764086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54871,"ondisk_log_size":54871,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":804040,"kb_used_data":296648,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":754170680,"statfs":{"total":773094113280,"available":772270776320,"internally_reserved":0,"allocated":303767552,"data_stored":302494644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":519491121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1387,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003249"},"pg_stats":[{"pgid":"3.3f","version":"23'599","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192547+0000","last_change":"2024-05-09T07:54:37.107065+0000","last_active":"2024-05-09T08:02:06.192547+0000","last_peered":"2024-05-09T08:02:06.192547+0000","last_clean":"2024-05-09T08:02:06.192547+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T08:02:06.192547+0000","last_undegraded":"2024-05-09T08:02:06.192547+0000","last_fullsized":"2024-05-09T08:02:06.192547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'629","reported_seq":648,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197366+0000","last_change":"2024-05-09T07:54:37.109460+0000","last_active":"2024-05-09T08:02:06.197366+0000","last_peered":"2024-05-09T08:02:06.197366+0000","last_clean":"2024-05-09T08:02:06.197366+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T08:02:06.197366+0000","last_undegraded":"2024-05-09T08:02:06.197366+0000","last_fullsized":"2024-05-09T08:02:06.197366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":3580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'592","reported_seq":611,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198154+0000","last_change":"2024-05-09T07:54:37.108923+0000","last_active":"2024-05-09T08:02:06.198154+0000","last_peered":"2024-05-09T08:02:06.198154+0000","last_clean":"2024-05-09T08:02:06.198154+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T08:02:06.198154+0000","last_undegraded":"2024-05-09T08:02:06.198154+0000","last_fullsized":"2024-05-09T08:02:06.198154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'587","reported_seq":606,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202093+0000","last_change":"2024-05-09T07:54:37.104600+0000","last_active":"2024-05-09T08:02:06.202093+0000","last_peered":"2024-05-09T08:02:06.202093+0000","last_clean":"2024-05-09T08:02:06.202093+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T08:02:06.202093+0000","last_undegraded":"2024-05-09T08:02:06.202093+0000","last_fullsized":"2024-05-09T08:02:06.202093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":3262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'613","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182772+0000","last_change":"2024-05-09T07:54:37.104101+0000","last_active":"2024-05-09T08:02:06.182772+0000","last_peered":"2024-05-09T08:02:06.182772+0000","last_clean":"2024-05-09T08:02:06.182772+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T08:02:06.182772+0000","last_undegraded":"2024-05-09T08:02:06.182772+0000","last_fullsized":"2024-05-09T08:02:06.182772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'586","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199162+0000","last_change":"2024-05-09T07:54:37.109462+0000","last_active":"2024-05-09T08:02:06.199162+0000","last_peered":"2024-05-09T08:02:06.199162+0000","last_clean":"2024-05-09T08:02:06.199162+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T08:02:06.199162+0000","last_undegraded":"2024-05-09T08:02:06.199162+0000","last_fullsized":"2024-05-09T08:02:06.199162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":3420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'619","reported_seq":638,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182552+0000","last_change":"2024-05-09T07:54:37.114222+0000","last_active":"2024-05-09T08:02:06.182552+0000","last_peered":"2024-05-09T08:02:06.182552+0000","last_clean":"2024-05-09T08:02:06.182552+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T08:02:06.182552+0000","last_undegraded":"2024-05-09T08:02:06.182552+0000","last_fullsized":"2024-05-09T08:02:06.182552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'582","reported_seq":601,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202534+0000","last_change":"2024-05-09T07:54:37.110852+0000","last_active":"2024-05-09T08:02:06.202534+0000","last_peered":"2024-05-09T08:02:06.202534+0000","last_clean":"2024-05-09T08:02:06.202534+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T08:02:06.202534+0000","last_undegraded":"2024-05-09T08:02:06.202534+0000","last_fullsized":"2024-05-09T08:02:06.202534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":3532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'626","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197188+0000","last_change":"2024-05-09T07:54:37.106997+0000","last_active":"2024-05-09T08:02:06.197188+0000","last_peered":"2024-05-09T08:02:06.197188+0000","last_clean":"2024-05-09T08:02:06.197188+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T08:02:06.197188+0000","last_undegraded":"2024-05-09T08:02:06.197188+0000","last_fullsized":"2024-05-09T08:02:06.197188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":762,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'591","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.181461+0000","last_change":"2024-05-09T07:54:37.112111+0000","last_active":"2024-05-09T08:02:06.181461+0000","last_peered":"2024-05-09T08:02:06.181461+0000","last_clean":"2024-05-09T08:02:06.181461+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T08:02:06.181461+0000","last_undegraded":"2024-05-09T08:02:06.181461+0000","last_fullsized":"2024-05-09T08:02:06.181461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":3173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'551","reported_seq":570,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179585+0000","last_change":"2024-05-09T07:54:37.111412+0000","last_active":"2024-05-09T08:02:06.179585+0000","last_peered":"2024-05-09T08:02:06.179585+0000","last_clean":"2024-05-09T08:02:06.179585+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T08:02:06.179585+0000","last_undegraded":"2024-05-09T08:02:06.179585+0000","last_fullsized":"2024-05-09T08:02:06.179585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'545","reported_seq":564,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179793+0000","last_change":"2024-05-09T07:54:37.103229+0000","last_active":"2024-05-09T08:02:06.179793+0000","last_peered":"2024-05-09T08:02:06.179793+0000","last_clean":"2024-05-09T08:02:06.179793+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T08:02:06.179793+0000","last_undegraded":"2024-05-09T08:02:06.179793+0000","last_fullsized":"2024-05-09T08:02:06.179793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'584","reported_seq":603,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202129+0000","last_change":"2024-05-09T07:54:37.104238+0000","last_active":"2024-05-09T08:02:06.202129+0000","last_peered":"2024-05-09T08:02:06.202129+0000","last_clean":"2024-05-09T08:02:06.202129+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T08:02:06.202129+0000","last_undegraded":"2024-05-09T08:02:06.202129+0000","last_fullsized":"2024-05-09T08:02:06.202129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":3698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'626","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.203263+0000","last_change":"2024-05-09T07:54:37.105958+0000","last_active":"2024-05-09T08:02:06.203263+0000","last_peered":"2024-05-09T08:02:06.203263+0000","last_clean":"2024-05-09T08:02:06.203263+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T08:02:06.203263+0000","last_undegraded":"2024-05-09T08:02:06.203263+0000","last_fullsized":"2024-05-09T08:02:06.203263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:33:38.316625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":3967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'617","reported_seq":636,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196088+0000","last_change":"2024-05-09T07:54:37.090690+0000","last_active":"2024-05-09T08:02:06.196088+0000","last_peered":"2024-05-09T08:02:06.196088+0000","last_clean":"2024-05-09T08:02:06.196088+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T08:02:06.196088+0000","last_undegraded":"2024-05-09T08:02:06.196088+0000","last_fullsized":"2024-05-09T08:02:06.196088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":3825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'651","reported_seq":670,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197138+0000","last_change":"2024-05-09T07:54:37.110834+0000","last_active":"2024-05-09T08:02:06.197138+0000","last_peered":"2024-05-09T08:02:06.197138+0000","last_clean":"2024-05-09T08:02:06.197138+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T08:02:06.197138+0000","last_undegraded":"2024-05-09T08:02:06.197138+0000","last_fullsized":"2024-05-09T08:02:06.197138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'630","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185714+0000","last_change":"2024-05-09T07:54:37.099545+0000","last_active":"2024-05-09T08:02:06.185714+0000","last_peered":"2024-05-09T08:02:06.185714+0000","last_clean":"2024-05-09T08:02:06.185714+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T08:02:06.185714+0000","last_undegraded":"2024-05-09T08:02:06.185714+0000","last_fullsized":"2024-05-09T08:02:06.185714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":3592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'592","reported_seq":611,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184552+0000","last_change":"2024-05-09T07:54:37.105054+0000","last_active":"2024-05-09T08:02:06.184552+0000","last_peered":"2024-05-09T08:02:06.184552+0000","last_clean":"2024-05-09T08:02:06.184552+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T08:02:06.184552+0000","last_undegraded":"2024-05-09T08:02:06.184552+0000","last_fullsized":"2024-05-09T08:02:06.184552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:11.769195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'619","reported_seq":632,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196667+0000","last_change":"2024-05-09T07:55:18.561520+0000","last_active":"2024-05-09T08:02:06.196667+0000","last_peered":"2024-05-09T08:02:06.196667+0000","last_clean":"2024-05-09T08:02:06.196667+0000","last_became_active":"2024-05-09T07:55:18.561115+0000","last_became_peered":"2024-05-09T07:55:18.561115+0000","last_unstale":"2024-05-09T08:02:06.196667+0000","last_undegraded":"2024-05-09T08:02:06.196667+0000","last_fullsized":"2024-05-09T08:02:06.196667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:59:48.961063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"23'657","reported_seq":676,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.178687+0000","last_change":"2024-05-09T07:54:37.110846+0000","last_active":"2024-05-09T08:02:06.178687+0000","last_peered":"2024-05-09T08:02:06.178687+0000","last_clean":"2024-05-09T08:02:06.178687+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T08:02:06.178687+0000","last_undegraded":"2024-05-09T08:02:06.178687+0000","last_fullsized":"2024-05-09T08:02:06.178687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'610","reported_seq":629,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.205481+0000","last_change":"2024-05-09T07:54:37.110392+0000","last_active":"2024-05-09T08:02:06.205481+0000","last_peered":"2024-05-09T08:02:06.205481+0000","last_clean":"2024-05-09T08:02:06.205481+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T08:02:06.205481+0000","last_undegraded":"2024-05-09T08:02:06.205481+0000","last_fullsized":"2024-05-09T08:02:06.205481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":3681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'647","reported_seq":666,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185643+0000","last_change":"2024-05-09T07:54:37.098797+0000","last_active":"2024-05-09T08:02:06.185643+0000","last_peered":"2024-05-09T08:02:06.185643+0000","last_clean":"2024-05-09T08:02:06.185643+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T08:02:06.185643+0000","last_undegraded":"2024-05-09T08:02:06.185643+0000","last_fullsized":"2024-05-09T08:02:06.185643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":798,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'606","reported_seq":625,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200517+0000","last_change":"2024-05-09T07:54:37.112262+0000","last_active":"2024-05-09T08:02:06.200517+0000","last_peered":"2024-05-09T08:02:06.200517+0000","last_clean":"2024-05-09T08:02:06.200517+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T08:02:06.200517+0000","last_undegraded":"2024-05-09T08:02:06.200517+0000","last_fullsized":"2024-05-09T08:02:06.200517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":3749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'666","reported_seq":685,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202404+0000","last_change":"2024-05-09T07:54:37.102723+0000","last_active":"2024-05-09T08:02:06.202404+0000","last_peered":"2024-05-09T08:02:06.202404+0000","last_clean":"2024-05-09T08:02:06.202404+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T08:02:06.202404+0000","last_undegraded":"2024-05-09T08:02:06.202404+0000","last_fullsized":"2024-05-09T08:02:06.202404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":3958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'636","reported_seq":655,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199477+0000","last_change":"2024-05-09T07:54:37.101021+0000","last_active":"2024-05-09T08:02:06.199477+0000","last_peered":"2024-05-09T08:02:06.199477+0000","last_clean":"2024-05-09T08:02:06.199477+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T08:02:06.199477+0000","last_undegraded":"2024-05-09T08:02:06.199477+0000","last_fullsized":"2024-05-09T08:02:06.199477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'718","reported_seq":737,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195868+0000","last_change":"2024-05-09T07:54:37.106515+0000","last_active":"2024-05-09T08:02:06.195868+0000","last_peered":"2024-05-09T08:02:06.195868+0000","last_clean":"2024-05-09T08:02:06.195868+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T08:02:06.195868+0000","last_undegraded":"2024-05-09T08:02:06.195868+0000","last_fullsized":"2024-05-09T08:02:06.195868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'618","reported_seq":637,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202609+0000","last_change":"2024-05-09T07:54:37.101475+0000","last_active":"2024-05-09T08:02:06.202609+0000","last_peered":"2024-05-09T08:02:06.202609+0000","last_clean":"2024-05-09T08:02:06.202609+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T08:02:06.202609+0000","last_undegraded":"2024-05-09T08:02:06.202609+0000","last_fullsized":"2024-05-09T08:02:06.202609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'588","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200874+0000","last_change":"2024-05-09T07:54:37.112908+0000","last_active":"2024-05-09T08:02:06.200874+0000","last_peered":"2024-05-09T08:02:06.200874+0000","last_clean":"2024-05-09T08:02:06.200874+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T08:02:06.200874+0000","last_undegraded":"2024-05-09T08:02:06.200874+0000","last_fullsized":"2024-05-09T08:02:06.200874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":3451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'618","reported_seq":637,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.204290+0000","last_change":"2024-05-09T07:54:37.109141+0000","last_active":"2024-05-09T08:02:06.204290+0000","last_peered":"2024-05-09T08:02:06.204290+0000","last_clean":"2024-05-09T08:02:06.204290+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T08:02:06.204290+0000","last_undegraded":"2024-05-09T08:02:06.204290+0000","last_fullsized":"2024-05-09T08:02:06.204290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'697","reported_seq":716,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194343+0000","last_change":"2024-05-09T07:54:37.103105+0000","last_active":"2024-05-09T08:02:06.194343+0000","last_peered":"2024-05-09T08:02:06.194343+0000","last_clean":"2024-05-09T08:02:06.194343+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T08:02:06.194343+0000","last_undegraded":"2024-05-09T08:02:06.194343+0000","last_fullsized":"2024-05-09T08:02:06.194343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:17:40.748211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":843,"num_write_kb":3831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'687","reported_seq":706,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.173818+0000","last_change":"2024-05-09T07:54:37.109657+0000","last_active":"2024-05-09T08:02:06.173818+0000","last_peered":"2024-05-09T08:02:06.173818+0000","last_clean":"2024-05-09T08:02:06.173818+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T08:02:06.173818+0000","last_undegraded":"2024-05-09T08:02:06.173818+0000","last_fullsized":"2024-05-09T08:02:06.173818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'658","reported_seq":677,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198966+0000","last_change":"2024-05-09T07:54:37.111278+0000","last_active":"2024-05-09T08:02:06.198966+0000","last_peered":"2024-05-09T08:02:06.198966+0000","last_clean":"2024-05-09T08:02:06.198966+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T08:02:06.198966+0000","last_undegraded":"2024-05-09T08:02:06.198966+0000","last_fullsized":"2024-05-09T08:02:06.198966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:56.798324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'616","reported_seq":635,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.193871+0000","last_change":"2024-05-09T07:54:37.099560+0000","last_active":"2024-05-09T08:02:06.193871+0000","last_peered":"2024-05-09T08:02:06.193871+0000","last_clean":"2024-05-09T08:02:06.193871+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T08:02:06.193871+0000","last_undegraded":"2024-05-09T08:02:06.193871+0000","last_fullsized":"2024-05-09T08:02:06.193871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:30.636185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":3676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'432","reported_seq":453,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.221372+0000","last_change":"2024-05-09T07:54:36.105511+0000","last_active":"2024-05-09T08:01:57.221372+0000","last_peered":"2024-05-09T08:01:57.221372+0000","last_clean":"2024-05-09T08:01:57.221372+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T08:01:57.221372+0000","last_undegraded":"2024-05-09T08:01:57.221372+0000","last_fullsized":"2024-05-09T08:01:57.221372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":480,"num_write_kb":8805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'556","reported_seq":575,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.206383+0000","last_change":"2024-05-09T07:54:37.110626+0000","last_active":"2024-05-09T08:02:06.206383+0000","last_peered":"2024-05-09T08:02:06.206383+0000","last_clean":"2024-05-09T08:02:06.206383+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T08:02:06.206383+0000","last_undegraded":"2024-05-09T08:02:06.206383+0000","last_fullsized":"2024-05-09T08:02:06.206383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":668,"num_write_kb":3012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'950","reported_seq":971,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.242506+0000","last_change":"2024-05-09T07:54:36.099522+0000","last_active":"2024-05-09T08:01:57.242506+0000","last_peered":"2024-05-09T08:01:57.242506+0000","last_clean":"2024-05-09T08:01:57.242506+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T08:01:57.242506+0000","last_undegraded":"2024-05-09T08:01:57.242506+0000","last_fullsized":"2024-05-09T08:01:57.242506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":950,"log_dups_size":0,"ondisk_log_size":950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1015,"num_write_kb":29485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'176","reported_seq":197,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.954166+0000","last_change":"2024-05-09T07:54:36.103352+0000","last_active":"2024-05-09T08:01:53.954166+0000","last_peered":"2024-05-09T08:01:53.954166+0000","last_clean":"2024-05-09T08:01:53.954166+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T08:01:53.954166+0000","last_undegraded":"2024-05-09T08:01:53.954166+0000","last_fullsized":"2024-05-09T08:01:53.954166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":217,"num_write_kb":8642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'671","reported_seq":690,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.198240+0000","last_change":"2024-05-09T07:54:37.113565+0000","last_active":"2024-05-09T08:02:06.198240+0000","last_peered":"2024-05-09T08:02:06.198240+0000","last_clean":"2024-05-09T08:02:06.198240+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T08:02:06.198240+0000","last_undegraded":"2024-05-09T08:02:06.198240+0000","last_fullsized":"2024-05-09T08:02:06.198240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'710","reported_seq":731,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.210384+0000","last_change":"2024-05-09T07:54:36.091893+0000","last_active":"2024-05-09T08:01:54.210384+0000","last_peered":"2024-05-09T08:01:54.210384+0000","last_clean":"2024-05-09T08:01:54.210384+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T08:01:54.210384+0000","last_undegraded":"2024-05-09T08:01:54.210384+0000","last_fullsized":"2024-05-09T08:01:54.210384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":749,"num_write_kb":37565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'621","reported_seq":640,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.202751+0000","last_change":"2024-05-09T07:54:37.106284+0000","last_active":"2024-05-09T08:02:06.202751+0000","last_peered":"2024-05-09T08:02:06.202751+0000","last_clean":"2024-05-09T08:02:06.202751+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T08:02:06.202751+0000","last_undegraded":"2024-05-09T08:02:06.202751+0000","last_fullsized":"2024-05-09T08:02:06.202751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":3585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'140","reported_seq":161,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.141597+0000","last_change":"2024-05-09T07:54:36.100068+0000","last_active":"2024-05-09T08:02:06.141597+0000","last_peered":"2024-05-09T08:02:06.141597+0000","last_clean":"2024-05-09T08:02:06.141597+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T08:02:06.141597+0000","last_undegraded":"2024-05-09T08:02:06.141597+0000","last_fullsized":"2024-05-09T08:02:06.141597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10381600,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":185,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'661","reported_seq":673,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.191831+0000","last_change":"2024-05-09T07:55:18.903031+0000","last_active":"2024-05-09T08:02:06.191831+0000","last_peered":"2024-05-09T08:02:06.191831+0000","last_clean":"2024-05-09T08:02:06.191831+0000","last_became_active":"2024-05-09T07:55:18.902706+0000","last_became_peered":"2024-05-09T07:55:18.902706+0000","last_unstale":"2024-05-09T08:02:06.191831+0000","last_undegraded":"2024-05-09T08:02:06.191831+0000","last_fullsized":"2024-05-09T08:02:06.191831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'443","reported_seq":464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.201493+0000","last_change":"2024-05-09T07:54:36.100368+0000","last_active":"2024-05-09T08:01:56.201493+0000","last_peered":"2024-05-09T08:01:56.201493+0000","last_clean":"2024-05-09T08:01:56.201493+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T08:01:56.201493+0000","last_undegraded":"2024-05-09T08:01:56.201493+0000","last_fullsized":"2024-05-09T08:01:56.201493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":490,"num_write_kb":25148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'591","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199607+0000","last_change":"2024-05-09T07:54:37.107847+0000","last_active":"2024-05-09T08:02:06.199607+0000","last_peered":"2024-05-09T08:02:06.199607+0000","last_clean":"2024-05-09T08:02:06.199607+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T08:02:06.199607+0000","last_undegraded":"2024-05-09T08:02:06.199607+0000","last_fullsized":"2024-05-09T08:02:06.199607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'768","reported_seq":789,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.276875+0000","last_change":"2024-05-09T07:54:36.101694+0000","last_active":"2024-05-09T08:01:57.276875+0000","last_peered":"2024-05-09T08:01:57.276875+0000","last_clean":"2024-05-09T08:01:57.276875+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T08:01:57.276875+0000","last_undegraded":"2024-05-09T08:01:57.276875+0000","last_fullsized":"2024-05-09T08:01:57.276875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":817,"num_write_kb":21310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'594","reported_seq":613,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195234+0000","last_change":"2024-05-09T07:54:37.098733+0000","last_active":"2024-05-09T08:02:06.195234+0000","last_peered":"2024-05-09T08:02:06.195234+0000","last_clean":"2024-05-09T08:02:06.195234+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T08:02:06.195234+0000","last_undegraded":"2024-05-09T08:02:06.195234+0000","last_fullsized":"2024-05-09T08:02:06.195234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:37:15.571989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'821","reported_seq":842,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.249921+0000","last_change":"2024-05-09T07:54:36.103096+0000","last_active":"2024-05-09T08:01:54.249921+0000","last_peered":"2024-05-09T08:01:54.249921+0000","last_clean":"2024-05-09T08:01:54.249921+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T08:01:54.249921+0000","last_undegraded":"2024-05-09T08:01:54.249921+0000","last_fullsized":"2024-05-09T08:01:54.249921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":851,"num_write_kb":25125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'612","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.185887+0000","last_change":"2024-05-09T07:54:37.101875+0000","last_active":"2024-05-09T08:02:06.185887+0000","last_peered":"2024-05-09T08:02:06.185887+0000","last_clean":"2024-05-09T08:02:06.185887+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T08:02:06.185887+0000","last_undegraded":"2024-05-09T08:02:06.185887+0000","last_fullsized":"2024-05-09T08:02:06.185887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'702","reported_seq":723,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:49.153612+0000","last_change":"2024-05-09T07:54:36.090977+0000","last_active":"2024-05-09T08:01:49.153612+0000","last_peered":"2024-05-09T08:01:49.153612+0000","last_clean":"2024-05-09T08:01:49.153612+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T08:01:49.153612+0000","last_undegraded":"2024-05-09T08:01:49.153612+0000","last_fullsized":"2024-05-09T08:01:49.153612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:34:17.768144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":750,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'628","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200287+0000","last_change":"2024-05-09T07:54:37.105813+0000","last_active":"2024-05-09T08:02:06.200287+0000","last_peered":"2024-05-09T08:02:06.200287+0000","last_clean":"2024-05-09T08:02:06.200287+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T08:02:06.200287+0000","last_undegraded":"2024-05-09T08:02:06.200287+0000","last_fullsized":"2024-05-09T08:02:06.200287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:02.185354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'74","reported_seq":95,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.208101+0000","last_change":"2024-05-09T07:54:36.102510+0000","last_active":"2024-05-09T08:01:56.208101+0000","last_peered":"2024-05-09T08:01:56.208101+0000","last_clean":"2024-05-09T08:01:56.208101+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T08:01:56.208101+0000","last_undegraded":"2024-05-09T08:01:56.208101+0000","last_fullsized":"2024-05-09T08:01:56.208101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":148,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.195420+0000","last_change":"2024-05-09T07:54:37.105015+0000","last_active":"2024-05-09T08:02:06.195420+0000","last_peered":"2024-05-09T08:02:06.195420+0000","last_clean":"2024-05-09T08:02:06.195420+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T08:02:06.195420+0000","last_undegraded":"2024-05-09T08:02:06.195420+0000","last_fullsized":"2024-05-09T08:02:06.195420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:53:35.205359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":3484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'101","reported_seq":122,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.227008+0000","last_change":"2024-05-09T07:54:36.103721+0000","last_active":"2024-05-09T08:01:57.227008+0000","last_peered":"2024-05-09T08:01:57.227008+0000","last_clean":"2024-05-09T08:01:57.227008+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T08:01:57.227008+0000","last_undegraded":"2024-05-09T08:01:57.227008+0000","last_fullsized":"2024-05-09T08:01:57.227008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":161,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'724","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.191153+0000","last_change":"2024-05-09T07:54:37.111215+0000","last_active":"2024-05-09T08:02:06.191153+0000","last_peered":"2024-05-09T08:02:06.191153+0000","last_clean":"2024-05-09T08:02:06.191153+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T08:02:06.191153+0000","last_undegraded":"2024-05-09T08:02:06.191153+0000","last_fullsized":"2024-05-09T08:02:06.191153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":3636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'183","reported_seq":204,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:52.188023+0000","last_change":"2024-05-09T07:54:36.098598+0000","last_active":"2024-05-09T08:01:52.188023+0000","last_peered":"2024-05-09T08:01:52.188023+0000","last_clean":"2024-05-09T08:01:52.188023+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T08:01:52.188023+0000","last_undegraded":"2024-05-09T08:01:52.188023+0000","last_fullsized":"2024-05-09T08:01:52.188023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":241,"num_write_kb":8581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'724","reported_seq":743,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.190619+0000","last_change":"2024-05-09T07:54:37.102764+0000","last_active":"2024-05-09T08:02:06.190619+0000","last_peered":"2024-05-09T08:02:06.190619+0000","last_clean":"2024-05-09T08:02:06.190619+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T08:02:06.190619+0000","last_undegraded":"2024-05-09T08:02:06.190619+0000","last_fullsized":"2024-05-09T08:02:06.190619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":3956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'289","reported_seq":310,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.201064+0000","last_change":"2024-05-09T07:54:36.092365+0000","last_active":"2024-05-09T08:01:56.201064+0000","last_peered":"2024-05-09T08:01:56.201064+0000","last_clean":"2024-05-09T08:01:56.201064+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T08:01:56.201064+0000","last_undegraded":"2024-05-09T08:01:56.201064+0000","last_fullsized":"2024-05-09T08:01:56.201064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":360,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'586","reported_seq":605,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192923+0000","last_change":"2024-05-09T07:54:37.100214+0000","last_active":"2024-05-09T08:02:06.192923+0000","last_peered":"2024-05-09T08:02:06.192923+0000","last_clean":"2024-05-09T08:02:06.192923+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T08:02:06.192923+0000","last_undegraded":"2024-05-09T08:02:06.192923+0000","last_fullsized":"2024-05-09T08:02:06.192923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:27:44.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":3597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'316","reported_seq":337,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.200234+0000","last_change":"2024-05-09T07:54:36.100004+0000","last_active":"2024-05-09T08:01:56.200234+0000","last_peered":"2024-05-09T08:01:56.200234+0000","last_clean":"2024-05-09T08:01:56.200234+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T08:01:56.200234+0000","last_undegraded":"2024-05-09T08:01:56.200234+0000","last_fullsized":"2024-05-09T08:01:56.200234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":351,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'580","reported_seq":599,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.197234+0000","last_change":"2024-05-09T07:54:37.100879+0000","last_active":"2024-05-09T08:02:06.197234+0000","last_peered":"2024-05-09T08:02:06.197234+0000","last_clean":"2024-05-09T08:02:06.197234+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T08:02:06.197234+0000","last_undegraded":"2024-05-09T08:02:06.197234+0000","last_fullsized":"2024-05-09T08:02:06.197234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'462","reported_seq":483,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.295843+0000","last_change":"2024-05-09T07:54:36.099594+0000","last_active":"2024-05-09T08:01:55.295843+0000","last_peered":"2024-05-09T08:01:55.295843+0000","last_clean":"2024-05-09T08:01:55.295843+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T08:01:55.295843+0000","last_undegraded":"2024-05-09T08:01:55.295843+0000","last_fullsized":"2024-05-09T08:01:55.295843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":512,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'682","reported_seq":695,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.182300+0000","last_change":"2024-05-09T07:55:18.559305+0000","last_active":"2024-05-09T08:02:06.182300+0000","last_peered":"2024-05-09T08:02:06.182300+0000","last_clean":"2024-05-09T08:02:06.182300+0000","last_became_active":"2024-05-09T07:55:18.558939+0000","last_became_peered":"2024-05-09T07:55:18.558939+0000","last_unstale":"2024-05-09T08:02:06.182300+0000","last_undegraded":"2024-05-09T08:02:06.182300+0000","last_fullsized":"2024-05-09T08:02:06.182300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:06:18.332825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"23'248","reported_seq":269,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.420616+0000","last_change":"2024-05-09T07:54:36.097398+0000","last_active":"2024-05-09T08:01:54.420616+0000","last_peered":"2024-05-09T08:01:54.420616+0000","last_clean":"2024-05-09T08:01:54.420616+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T08:01:54.420616+0000","last_undegraded":"2024-05-09T08:01:54.420616+0000","last_fullsized":"2024-05-09T08:01:54.420616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:56:24.826671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":299,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'588","reported_seq":607,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.187188+0000","last_change":"2024-05-09T07:54:37.108574+0000","last_active":"2024-05-09T08:02:06.187188+0000","last_peered":"2024-05-09T08:02:06.187188+0000","last_clean":"2024-05-09T08:02:06.187188+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T08:02:06.187188+0000","last_undegraded":"2024-05-09T08:02:06.187188+0000","last_fullsized":"2024-05-09T08:02:06.187188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:07:26.942463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":3417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T07:58:28.929423+0000","last_change":"2024-05-09T07:54:26.681190+0000","last_active":"2024-05-09T07:58:28.929423+0000","last_peered":"2024-05-09T07:58:28.929423+0000","last_clean":"2024-05-09T07:58:28.929423+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T07:58:28.929423+0000","last_undegraded":"2024-05-09T07:58:28.929423+0000","last_fullsized":"2024-05-09T07:58:28.929423+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:25.041611+0000","last_clean_scrub_stamp":"2024-05-09T07:54:25.041611+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:36.113213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'199","reported_seq":220,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.423265+0000","last_change":"2024-05-09T07:54:36.097635+0000","last_active":"2024-05-09T08:01:54.423265+0000","last_peered":"2024-05-09T08:01:54.423265+0000","last_clean":"2024-05-09T08:01:54.423265+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T08:01:54.423265+0000","last_undegraded":"2024-05-09T08:01:54.423265+0000","last_fullsized":"2024-05-09T08:01:54.423265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:25:26.850221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":237,"num_write_kb":12549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'566","reported_seq":585,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.192763+0000","last_change":"2024-05-09T07:54:37.111470+0000","last_active":"2024-05-09T08:02:06.192763+0000","last_peered":"2024-05-09T08:02:06.192763+0000","last_clean":"2024-05-09T08:02:06.192763+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T08:02:06.192763+0000","last_undegraded":"2024-05-09T08:02:06.192763+0000","last_fullsized":"2024-05-09T08:02:06.192763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":3530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'754","reported_seq":775,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.206375+0000","last_change":"2024-05-09T07:54:36.107162+0000","last_active":"2024-05-09T08:01:56.206375+0000","last_peered":"2024-05-09T08:01:56.206375+0000","last_clean":"2024-05-09T08:01:56.206375+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T08:01:56.206375+0000","last_undegraded":"2024-05-09T08:01:56.206375+0000","last_fullsized":"2024-05-09T08:01:56.206375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":793,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184193+0000","last_change":"2024-05-09T07:54:37.102062+0000","last_active":"2024-05-09T08:02:06.184193+0000","last_peered":"2024-05-09T08:02:06.184193+0000","last_clean":"2024-05-09T08:02:06.184193+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T08:02:06.184193+0000","last_undegraded":"2024-05-09T08:02:06.184193+0000","last_fullsized":"2024-05-09T08:02:06.184193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:32.555846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":3702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'938","reported_seq":1645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:58.206696+0000","last_change":"2024-05-09T07:54:36.100227+0000","last_active":"2024-05-09T08:01:58.206696+0000","last_peered":"2024-05-09T08:01:58.206696+0000","last_clean":"2024-05-09T08:01:58.206696+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T08:01:58.206696+0000","last_undegraded":"2024-05-09T08:01:58.206696+0000","last_fullsized":"2024-05-09T08:01:58.206696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512596,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":706,"num_read_kb":1945,"num_write":995,"num_write_kb":14766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'603","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194027+0000","last_change":"2024-05-09T07:54:37.109167+0000","last_active":"2024-05-09T08:02:06.194027+0000","last_peered":"2024-05-09T08:02:06.194027+0000","last_clean":"2024-05-09T08:02:06.194027+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T08:02:06.194027+0000","last_undegraded":"2024-05-09T08:02:06.194027+0000","last_fullsized":"2024-05-09T08:02:06.194027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":3437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'650","reported_seq":671,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:54.250789+0000","last_change":"2024-05-09T07:54:36.100426+0000","last_active":"2024-05-09T08:01:54.250789+0000","last_peered":"2024-05-09T08:01:54.250789+0000","last_clean":"2024-05-09T08:01:54.250789+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T08:01:54.250789+0000","last_undegraded":"2024-05-09T08:01:54.250789+0000","last_fullsized":"2024-05-09T08:01:54.250789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":708,"num_write_kb":29261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'605","reported_seq":624,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194904+0000","last_change":"2024-05-09T07:54:37.108794+0000","last_active":"2024-05-09T08:02:06.194904+0000","last_peered":"2024-05-09T08:02:06.194904+0000","last_clean":"2024-05-09T08:02:06.194904+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T08:02:06.194904+0000","last_undegraded":"2024-05-09T08:02:06.194904+0000","last_fullsized":"2024-05-09T08:02:06.194904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:43.498827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'182","reported_seq":203,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.203877+0000","last_change":"2024-05-09T07:54:36.104155+0000","last_active":"2024-05-09T08:01:56.203877+0000","last_peered":"2024-05-09T08:01:56.203877+0000","last_clean":"2024-05-09T08:01:56.203877+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T08:01:56.203877+0000","last_undegraded":"2024-05-09T08:01:56.203877+0000","last_fullsized":"2024-05-09T08:01:56.203877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":263,"num_write_kb":8685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'644","reported_seq":663,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194002+0000","last_change":"2024-05-09T07:54:37.103562+0000","last_active":"2024-05-09T08:02:06.194002+0000","last_peered":"2024-05-09T08:02:06.194002+0000","last_clean":"2024-05-09T08:02:06.194002+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T08:02:06.194002+0000","last_undegraded":"2024-05-09T08:02:06.194002+0000","last_fullsized":"2024-05-09T08:02:06.194002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:51:25.732914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'488","reported_seq":509,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.207750+0000","last_change":"2024-05-09T07:54:36.106399+0000","last_active":"2024-05-09T08:01:56.207750+0000","last_peered":"2024-05-09T08:01:56.207750+0000","last_clean":"2024-05-09T08:01:56.207750+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T08:01:56.207750+0000","last_undegraded":"2024-05-09T08:01:56.207750+0000","last_fullsized":"2024-05-09T08:01:56.207750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":548,"num_write_kb":21106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'589","reported_seq":608,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.196818+0000","last_change":"2024-05-09T07:54:37.105988+0000","last_active":"2024-05-09T08:02:06.196818+0000","last_peered":"2024-05-09T08:02:06.196818+0000","last_clean":"2024-05-09T08:02:06.196818+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T08:02:06.196818+0000","last_undegraded":"2024-05-09T08:02:06.196818+0000","last_fullsized":"2024-05-09T08:02:06.196818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:24.391251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":3737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'475","reported_seq":496,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:00.873819+0000","last_change":"2024-05-09T07:54:36.101002+0000","last_active":"2024-05-09T08:02:00.873819+0000","last_peered":"2024-05-09T08:02:00.873819+0000","last_clean":"2024-05-09T08:02:00.873819+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T08:02:00.873819+0000","last_undegraded":"2024-05-09T08:02:00.873819+0000","last_fullsized":"2024-05-09T08:02:00.873819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:03:10.765224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1199,"num_write_kb":9658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'541","reported_seq":560,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.184733+0000","last_change":"2024-05-09T07:54:37.100183+0000","last_active":"2024-05-09T08:02:06.184733+0000","last_peered":"2024-05-09T08:02:06.184733+0000","last_clean":"2024-05-09T08:02:06.184733+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T08:02:06.184733+0000","last_undegraded":"2024-05-09T08:02:06.184733+0000","last_fullsized":"2024-05-09T08:02:06.184733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:29.404428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'250","reported_seq":271,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:56.209315+0000","last_change":"2024-05-09T07:54:36.105813+0000","last_active":"2024-05-09T08:01:56.209315+0000","last_peered":"2024-05-09T08:01:56.209315+0000","last_clean":"2024-05-09T08:01:56.209315+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T08:01:56.209315+0000","last_undegraded":"2024-05-09T08:01:56.209315+0000","last_fullsized":"2024-05-09T08:01:56.209315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":329,"num_write_kb":8747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'732","reported_seq":751,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.201728+0000","last_change":"2024-05-09T07:54:37.107782+0000","last_active":"2024-05-09T08:02:06.201728+0000","last_peered":"2024-05-09T08:02:06.201728+0000","last_clean":"2024-05-09T08:02:06.201728+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T08:02:06.201728+0000","last_undegraded":"2024-05-09T08:02:06.201728+0000","last_fullsized":"2024-05-09T08:02:06.201728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:41:21.691871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'189","reported_seq":210,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.297656+0000","last_change":"2024-05-09T07:54:36.106409+0000","last_active":"2024-05-09T08:01:55.297656+0000","last_peered":"2024-05-09T08:01:55.297656+0000","last_clean":"2024-05-09T08:01:55.297656+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T08:01:55.297656+0000","last_undegraded":"2024-05-09T08:01:55.297656+0000","last_fullsized":"2024-05-09T08:01:55.297656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:30.593024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":230,"num_write_kb":8511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'679","reported_seq":698,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.179837+0000","last_change":"2024-05-09T07:54:37.104920+0000","last_active":"2024-05-09T08:02:06.179837+0000","last_peered":"2024-05-09T08:02:06.179837+0000","last_clean":"2024-05-09T08:02:06.179837+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T08:02:06.179837+0000","last_undegraded":"2024-05-09T08:02:06.179837+0000","last_fullsized":"2024-05-09T08:02:06.179837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:27.516423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":3995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'230","reported_seq":251,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:52.209441+0000","last_change":"2024-05-09T07:54:36.105662+0000","last_active":"2024-05-09T08:01:52.209441+0000","last_peered":"2024-05-09T08:01:52.209441+0000","last_clean":"2024-05-09T08:01:52.209441+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T08:01:52.209441+0000","last_undegraded":"2024-05-09T08:01:52.209441+0000","last_fullsized":"2024-05-09T08:01:52.209441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":261,"num_write_kb":12547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'635","reported_seq":654,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.200088+0000","last_change":"2024-05-09T07:54:37.103640+0000","last_active":"2024-05-09T08:02:06.200088+0000","last_peered":"2024-05-09T08:02:06.200088+0000","last_clean":"2024-05-09T08:02:06.200088+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T08:02:06.200088+0000","last_undegraded":"2024-05-09T08:02:06.200088+0000","last_fullsized":"2024-05-09T08:02:06.200088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:44:53.637018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'493","reported_seq":514,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.222839+0000","last_change":"2024-05-09T07:54:36.102636+0000","last_active":"2024-05-09T08:01:57.222839+0000","last_peered":"2024-05-09T08:01:57.222839+0000","last_clean":"2024-05-09T08:01:57.222839+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T08:01:57.222839+0000","last_undegraded":"2024-05-09T08:01:57.222839+0000","last_fullsized":"2024-05-09T08:01:57.222839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:55:13.315383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":567,"num_write_kb":25391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'646","reported_seq":659,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.201248+0000","last_change":"2024-05-09T07:55:18.902612+0000","last_active":"2024-05-09T08:02:06.201248+0000","last_peered":"2024-05-09T08:02:06.201248+0000","last_clean":"2024-05-09T08:02:06.201248+0000","last_became_active":"2024-05-09T07:55:18.902275+0000","last_became_peered":"2024-05-09T07:55:18.902275+0000","last_unstale":"2024-05-09T08:02:06.201248+0000","last_undegraded":"2024-05-09T08:02:06.201248+0000","last_fullsized":"2024-05-09T08:02:06.201248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:54.608551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":3818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"23'887","reported_seq":908,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:50.185785+0000","last_change":"2024-05-09T07:54:36.104367+0000","last_active":"2024-05-09T08:01:50.185785+0000","last_peered":"2024-05-09T08:01:50.185785+0000","last_clean":"2024-05-09T08:01:50.185785+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T08:01:50.185785+0000","last_undegraded":"2024-05-09T08:01:50.185785+0000","last_fullsized":"2024-05-09T08:01:50.185785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:43:42.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":934,"num_write_kb":29264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'642","reported_seq":661,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.180045+0000","last_change":"2024-05-09T07:54:37.111038+0000","last_active":"2024-05-09T08:02:06.180045+0000","last_peered":"2024-05-09T08:02:06.180045+0000","last_clean":"2024-05-09T08:02:06.180045+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T08:02:06.180045+0000","last_undegraded":"2024-05-09T08:02:06.180045+0000","last_fullsized":"2024-05-09T08:02:06.180045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:34:18.462610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":3781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'597","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.178625+0000","last_change":"2024-05-09T07:55:18.558479+0000","last_active":"2024-05-09T08:02:06.178625+0000","last_peered":"2024-05-09T08:02:06.178625+0000","last_clean":"2024-05-09T08:02:06.178625+0000","last_became_active":"2024-05-09T07:55:18.558037+0000","last_became_peered":"2024-05-09T07:55:18.558037+0000","last_unstale":"2024-05-09T08:02:06.178625+0000","last_undegraded":"2024-05-09T08:02:06.178625+0000","last_fullsized":"2024-05-09T08:02:06.178625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:46.535800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'190","reported_seq":211,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:57.240539+0000","last_change":"2024-05-09T07:54:36.105726+0000","last_active":"2024-05-09T08:01:57.240539+0000","last_peered":"2024-05-09T08:01:57.240539+0000","last_clean":"2024-05-09T08:01:57.240539+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T08:01:57.240539+0000","last_undegraded":"2024-05-09T08:01:57.240539+0000","last_fullsized":"2024-05-09T08:01:57.240539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:49:29.632214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":262,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'590","reported_seq":609,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.172605+0000","last_change":"2024-05-09T07:54:37.092061+0000","last_active":"2024-05-09T08:02:06.172605+0000","last_peered":"2024-05-09T08:02:06.172605+0000","last_clean":"2024-05-09T08:02:06.172605+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T08:02:06.172605+0000","last_undegraded":"2024-05-09T08:02:06.172605+0000","last_fullsized":"2024-05-09T08:02:06.172605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:39:28.348965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1115","reported_seq":1136,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.157658+0000","last_change":"2024-05-09T07:54:36.106635+0000","last_active":"2024-05-09T08:01:53.157658+0000","last_peered":"2024-05-09T08:01:53.157658+0000","last_clean":"2024-05-09T08:01:53.157658+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T08:01:53.157658+0000","last_undegraded":"2024-05-09T08:01:53.157658+0000","last_fullsized":"2024-05-09T08:01:53.157658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:51:26.512452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1161,"num_write_kb":29324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'532","reported_seq":551,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.199819+0000","last_change":"2024-05-09T07:54:37.108470+0000","last_active":"2024-05-09T08:02:06.199819+0000","last_peered":"2024-05-09T08:02:06.199819+0000","last_clean":"2024-05-09T08:02:06.199819+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T08:02:06.199819+0000","last_undegraded":"2024-05-09T08:02:06.199819+0000","last_fullsized":"2024-05-09T08:02:06.199819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:01.712304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":3333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'708","reported_seq":729,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:55.297864+0000","last_change":"2024-05-09T07:54:36.102502+0000","last_active":"2024-05-09T08:01:55.297864+0000","last_peered":"2024-05-09T08:01:55.297864+0000","last_clean":"2024-05-09T08:01:55.297864+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T08:01:55.297864+0000","last_undegraded":"2024-05-09T08:01:55.297864+0000","last_fullsized":"2024-05-09T08:01:55.297864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:46:57.093769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":745,"num_write_kb":29116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'614","reported_seq":633,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:06.194093+0000","last_change":"2024-05-09T07:54:37.104598+0000","last_active":"2024-05-09T08:02:06.194093+0000","last_peered":"2024-05-09T08:02:06.194093+0000","last_clean":"2024-05-09T08:02:06.194093+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T08:02:06.194093+0000","last_undegraded":"2024-05-09T08:02:06.194093+0000","last_fullsized":"2024-05-09T08:02:06.194093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:36.079119+0000","last_clean_scrub_stamp":"2024-05-09T07:54:36.079119+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:30.324782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'491","reported_seq":512,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:01:53.157976+0000","last_change":"2024-05-09T07:54:36.101744+0000","last_active":"2024-05-09T08:01:53.157976+0000","last_peered":"2024-05-09T08:01:53.157976+0000","last_clean":"2024-05-09T08:01:53.157976+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T08:01:53.157976+0000","last_undegraded":"2024-05-09T08:01:53.157976+0000","last_fullsized":"2024-05-09T08:01:53.157976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T07:54:35.075148+0000","last_clean_scrub_stamp":"2024-05-09T07:54:35.075148+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:19:12.175711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":559,"num_write_kb":8798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48848,"num_write_kb":235793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39700,"ondisk_log_size":39700,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":150307698,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1306,"num_read_kb":1945,"num_write":17417,"num_write_kb":525877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":300679168,"data_stored":300615396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15054,"ondisk_log_size":15054,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542242,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102712,"kb_used_data":53488,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94269128,"statfs":{"total":96636764160,"available":96531587072,"internally_reserved":0,"allocated":54771712,"data_stored":54613426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542242,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":21304,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":21815296,"data_stored":21649840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100920,"kb_used_data":29488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270920,"statfs":{"total":96636764160,"available":96533422080,"internally_reserved":0,"allocated":30195712,"data_stored":30038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574945,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122772,"kb_used_data":47244,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94249068,"statfs":{"total":96636764160,"available":96511045632,"internally_reserved":0,"allocated":48377856,"data_stored":48218322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108752,"kb_used_data":59528,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94263088,"statfs":{"total":96636764160,"available":96525402112,"internally_reserved":0,"allocated":60956672,"data_stored":60800652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116668,"kb_used_data":45300,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94255172,"statfs":{"total":96636764160,"available":96517296128,"internally_reserved":0,"allocated":46387200,"data_stored":46224784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101824,"kb_used_data":26296,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94270016,"statfs":{"total":96636764160,"available":96532496384,"internally_reserved":0,"allocated":26927104,"data_stored":26766406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77330887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574945,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71544,"kb_used_data":14000,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300296,"statfs":{"total":96636764160,"available":96563503104,"internally_reserved":0,"allocated":14336000,"data_stored":14182822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":54534144,"data_stored":54526112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14098432,"data_stored":14095508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26689536,"data_stored":26679092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":60719104,"data_stored":60713338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48140288,"data_stored":48131008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T08:02:18.950 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.950 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.950 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.950 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.950 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.950 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.950 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.950 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.951 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.951 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.951 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.951 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.951 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.951 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.951 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.951 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.951 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.952 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.953 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.954 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.954 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.954 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.954 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.954 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.954 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.954 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.954 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.954 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.955 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.956 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.956 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.956 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.956 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.956 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.956 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.956 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.956 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.956 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T07:54:25.041611+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=25, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.957 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.958 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.958 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.958 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.958 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.958 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.958 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.958 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.958 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.958 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.959 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.960 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.960 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-09T07:54:36.079119+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=36, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.960 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-09T07:54:35.075148+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=7, tm_min=54, tm_sec=35, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=8, tm_min=2, tm_sec=14, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T08:02:18.960 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T08:02:28.780 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T08:02:28.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T08:02:38.961 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T08:02:39.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.058+0000 7fe03d2b3640 1 Processor -- start 2024-05-09T08:02:39.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.058+0000 7fe03d2b3640 1 -- start start 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.059+0000 7fe03d2b3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 0x7fe03814f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.059+0000 7fe03d2b3640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0380b3770 con 0x7fe0380af1b0 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.059+0000 7fe03d2b3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0380b5530 con 0x7fe0380af900 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.059+0000 7fe03d2b3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe0380b3d80 con 0x7fe0380b4920 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.059+0000 7fe02e7fc640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe0380af1b0 0x7fe0380b4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49320/0 (socket says 172.21.15.87:49320) 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.059+0000 7fe02e7fc640 1 -- 172.21.15.87:0/1363364658 learned_addr learned my addr 172.21.15.87:0/1363364658 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.059+0000 7fe0377fe640 1 --2- 172.21.15.87:0/1363364658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 0x7fe03814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.060+0000 7fe0367fc640 1 -- 172.21.15.87:0/1363364658 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262192093 0 0) 0x7fe0380b3770 con 0x7fe0380af1b0 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.060+0000 7fe0367fc640 1 -- 172.21.15.87:0/1363364658 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe024003520 con 0x7fe0380af1b0 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.060+0000 7fe0367fc640 1 -- 172.21.15.87:0/1363364658 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3642296701 0 0) 0x7fe0380b5530 con 0x7fe0380af900 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.060+0000 7fe0367fc640 1 -- 172.21.15.87:0/1363364658 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0380b3770 con 0x7fe0380af900 2024-05-09T08:02:39.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.060+0000 7fe0377fe640 1 -- 172.21.15.87:0/1363364658 >> v1:172.21.15.110:6789/0 conn(0x7fe0380af900 legacy=0x7fe0380b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.060+0000 7fe0377fe640 1 -- 172.21.15.87:0/1363364658 >> v1:172.21.15.87:6789/0 conn(0x7fe0380af1b0 legacy=0x7fe0380b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.060+0000 7fe0377fe640 1 -- 172.21.15.87:0/1363364658 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0380b3a10 con 0x7fe0380b4920 2024-05-09T08:02:39.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe0377fe640 1 --2- 172.21.15.87:0/1363364658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 0x7fe03814f550 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe030009dc0 tx=0x7fe03002a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d4aa47749be27bf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:39.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe0367fc640 1 -- 172.21.15.87:0/1363364658 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030007740 con 0x7fe0380b4920 2024-05-09T08:02:39.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe0367fc640 1 -- 172.21.15.87:0/1363364658 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0300078e0 con 0x7fe0380b4920 2024-05-09T08:02:39.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe0367fc640 1 -- 172.21.15.87:0/1363364658 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030007cb0 con 0x7fe0380b4920 2024-05-09T08:02:39.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe03d2b3640 1 -- 172.21.15.87:0/1363364658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 msgr2=0x7fe03814f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe03d2b3640 1 --2- 172.21.15.87:0/1363364658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 0x7fe03814f550 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe030009dc0 tx=0x7fe03002a5b0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe03d2b3640 1 -- 172.21.15.87:0/1363364658 shutdown_connections 2024-05-09T08:02:39.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe03d2b3640 1 --2- 172.21.15.87:0/1363364658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 0x7fe03814f550 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe03d2b3640 1 -- 172.21.15.87:0/1363364658 >> 172.21.15.87:0/1363364658 conn(0x7fe03806c6a0 msgr2=0x7fe03806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:39.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe03d2b3640 1 -- 172.21.15.87:0/1363364658 shutdown_connections 2024-05-09T08:02:39.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.061+0000 7fe03d2b3640 1 -- 172.21.15.87:0/1363364658 wait complete. 2024-05-09T08:02:39.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe03d2b3640 1 Processor -- start 2024-05-09T08:02:39.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe03d2b3640 1 -- start start 2024-05-09T08:02:39.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe03d2b3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0380af1b0 0x7fe0380b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe03d2b3640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0380af900 0x7fe038070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe03d2b3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 0x7fe0381daa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe03d2b3640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fe0380ade30 con 0x7fe0380af900 2024-05-09T08:02:39.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe03d2b3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe0380b0ed0 con 0x7fe0380af1b0 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe03d2b3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fe0380adfb0 con 0x7fe0380b4920 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe02e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0380af900 0x7fe038070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe02e7fc640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0380af900 0x7fe038070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33928/0 (socket says 172.21.15.87:33928) 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.063+0000 7fe02e7fc640 1 -- 172.21.15.87:0/3187776541 learned_addr learned my addr 172.21.15.87:0/3187776541 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe036ffd640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0380af1b0 0x7fe0380b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe0377fe640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 0x7fe0381daa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe02e7fc640 1 -- 172.21.15.87:0/3187776541 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 msgr2=0x7fe0381daa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe02e7fc640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 0x7fe0381daa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe02e7fc640 1 -- 172.21.15.87:0/3187776541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0380af1b0 msgr2=0x7fe0380b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe02e7fc640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0380af1b0 0x7fe0380b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe02e7fc640 1 -- 172.21.15.87:0/3187776541 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0381cf380 con 0x7fe0380af900 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe02e7fc640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0380af900 0x7fe038070b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c4c0 tx=0x7fe02000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe02ffff640 1 -- 172.21.15.87:0/3187776541 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020017070 con 0x7fe0380af900 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe02ffff640 1 -- 172.21.15.87:0/3187776541 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe020005da0 con 0x7fe0380af900 2024-05-09T08:02:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03806f590 con 0x7fe0380af900 2024-05-09T08:02:39.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe02ffff640 1 -- 172.21.15.87:0/3187776541 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020007290 con 0x7fe0380af900 2024-05-09T08:02:39.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.064+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03806fb50 con 0x7fe0380af900 2024-05-09T08:02:39.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.065+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0380691f0 con 0x7fe0380af900 2024-05-09T08:02:39.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.066+0000 7fe02ffff640 1 -- 172.21.15.87:0/3187776541 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe02001a070 con 0x7fe0380af900 2024-05-09T08:02:39.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.066+0000 7fe02ffff640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe01806be60 0x7fe01806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.084 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.066+0000 7fe02ffff640 1 -- 172.21.15.87:0/3187776541 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7fe02008a190 con 0x7fe0380af900 2024-05-09T08:02:39.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.066+0000 7fe036ffd640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe01806be60 0x7fe01806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.085 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.067+0000 7fe036ffd640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe01806be60 0x7fe01806e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe028007fd0 tx=0x7fe028009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:39.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.071+0000 7fe02ffff640 1 -- 172.21.15.87:0/3187776541 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe020058470 con 0x7fe0380af900 2024-05-09T08:02:39.257 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.240+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 --> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0380b6b10 con 0x7fe01806be60 2024-05-09T08:02:39.263 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.246+0000 7fe02ffff640 1 -- 172.21.15.87:0/3187776541 <== mgr.4113 v2:172.21.15.87:6832/1321160324 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254079 (secure 0 0 0) 0x7fe0380b6b10 con 0x7fe01806be60 2024-05-09T08:02:39.266 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:39.268 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2024-05-09T08:02:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe01806be60 msgr2=0x7fe01806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe01806be60 0x7fe01806e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe028007fd0 tx=0x7fe028009040 comp rx=0 tx=0).stop 2024-05-09T08:02:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0380af900 msgr2=0x7fe038070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0380af900 0x7fe038070b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe02000c4c0 tx=0x7fe02000c980 comp rx=0 tx=0).stop 2024-05-09T08:02:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 shutdown_connections 2024-05-09T08:02:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7fe01806be60 0x7fe01806e320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0380b4920 0x7fe0381daa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.270 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0380af900 0x7fe038070b60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 --2- 172.21.15.87:0/3187776541 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0380af1b0 0x7fe0380b87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 >> 172.21.15.87:0/3187776541 conn(0x7fe03806c6a0 msgr2=0x7fe0380b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 shutdown_connections 2024-05-09T08:02:39.271 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.249+0000 7fe03d2b3640 1 -- 172.21.15.87:0/3187776541 wait complete. 2024-05-09T08:02:39.277 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-05-09T08:02:38.991315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":150898066,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1422,"num_read_kb":2045,"num_write":66424,"num_write_kb":764086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5987,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54925,"ondisk_log_size":54925,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":808200,"kb_used_data":296648,"kb_used_omap":12,"kb_used_meta":511475,"kb_avail":754166520,"statfs":{"total":773094113280,"available":772266516480,"internally_reserved":0,"allocated":303767552,"data_stored":302494644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":523750961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002901"},"pg_stats":[{"pgid":"3.3f","version":"23'599","reported_seq":627,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:33.460211+0000","last_change":"2024-05-09T08:02:33.460239+0000","last_active":"2024-05-09T08:02:33.460211+0000","last_peered":"2024-05-09T08:02:33.460211+0000","last_clean":"2024-05-09T08:02:33.460211+0000","last_became_active":"2024-05-09T07:54:37.106748+0000","last_became_peered":"2024-05-09T07:54:37.106748+0000","last_unstale":"2024-05-09T08:02:33.460211+0000","last_undegraded":"2024-05-09T08:02:33.460211+0000","last_fullsized":"2024-05-09T08:02:33.460211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'599","last_scrub_stamp":"2024-05-09T08:02:33.460113+0000","last_deep_scrub":"23'599","last_deep_scrub_stamp":"2024-05-09T08:02:33.460113+0000","last_clean_scrub_stamp":"2024-05-09T08:02:33.460113+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:48:57.700304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'629","reported_seq":657,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:27.242796+0000","last_change":"2024-05-09T08:02:27.242837+0000","last_active":"2024-05-09T08:02:27.242796+0000","last_peered":"2024-05-09T08:02:27.242796+0000","last_clean":"2024-05-09T08:02:27.242796+0000","last_became_active":"2024-05-09T07:54:37.108633+0000","last_became_peered":"2024-05-09T07:54:37.108633+0000","last_unstale":"2024-05-09T08:02:27.242796+0000","last_undegraded":"2024-05-09T08:02:27.242796+0000","last_fullsized":"2024-05-09T08:02:27.242796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'629","last_scrub_stamp":"2024-05-09T08:02:27.242697+0000","last_deep_scrub":"23'629","last_deep_scrub_stamp":"2024-05-09T08:02:27.242697+0000","last_clean_scrub_stamp":"2024-05-09T08:02:27.242697+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:52.462781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":773,"num_write_kb":3580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'592","reported_seq":620,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:25.305880+0000","last_change":"2024-05-09T08:02:25.305923+0000","last_active":"2024-05-09T08:02:25.305880+0000","last_peered":"2024-05-09T08:02:25.305880+0000","last_clean":"2024-05-09T08:02:25.305880+0000","last_became_active":"2024-05-09T07:54:37.108239+0000","last_became_peered":"2024-05-09T07:54:37.108239+0000","last_unstale":"2024-05-09T08:02:25.305880+0000","last_undegraded":"2024-05-09T08:02:25.305880+0000","last_fullsized":"2024-05-09T08:02:25.305880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'592","last_scrub_stamp":"2024-05-09T08:02:25.305752+0000","last_deep_scrub":"23'592","last_deep_scrub_stamp":"2024-05-09T08:02:25.305752+0000","last_clean_scrub_stamp":"2024-05-09T08:02:25.305752+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:54.731697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":724,"num_write_kb":3509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'587","reported_seq":616,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:29.349717+0000","last_change":"2024-05-09T08:02:29.349717+0000","last_active":"2024-05-09T08:02:29.349717+0000","last_peered":"2024-05-09T08:02:29.349717+0000","last_clean":"2024-05-09T08:02:29.349717+0000","last_became_active":"2024-05-09T07:54:37.104188+0000","last_became_peered":"2024-05-09T07:54:37.104188+0000","last_unstale":"2024-05-09T08:02:29.349717+0000","last_undegraded":"2024-05-09T08:02:29.349717+0000","last_fullsized":"2024-05-09T08:02:29.349717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'587","last_scrub_stamp":"2024-05-09T08:02:29.349598+0000","last_deep_scrub":"23'587","last_deep_scrub_stamp":"2024-05-09T08:02:29.349598+0000","last_clean_scrub_stamp":"2024-05-09T08:02:29.349598+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:48.271252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":3262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'613","reported_seq":641,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:30.439420+0000","last_change":"2024-05-09T08:02:30.439450+0000","last_active":"2024-05-09T08:02:30.439420+0000","last_peered":"2024-05-09T08:02:30.439420+0000","last_clean":"2024-05-09T08:02:30.439420+0000","last_became_active":"2024-05-09T07:54:37.103808+0000","last_became_peered":"2024-05-09T07:54:37.103808+0000","last_unstale":"2024-05-09T08:02:30.439420+0000","last_undegraded":"2024-05-09T08:02:30.439420+0000","last_fullsized":"2024-05-09T08:02:30.439420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'613","last_scrub_stamp":"2024-05-09T08:02:30.439306+0000","last_deep_scrub":"23'613","last_deep_scrub_stamp":"2024-05-09T08:02:30.439306+0000","last_clean_scrub_stamp":"2024-05-09T08:02:30.439306+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:38.673114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'586","reported_seq":614,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:30.360184+0000","last_change":"2024-05-09T08:02:30.360213+0000","last_active":"2024-05-09T08:02:30.360184+0000","last_peered":"2024-05-09T08:02:30.360184+0000","last_clean":"2024-05-09T08:02:30.360184+0000","last_became_active":"2024-05-09T07:54:37.109210+0000","last_became_peered":"2024-05-09T07:54:37.109210+0000","last_unstale":"2024-05-09T08:02:30.360184+0000","last_undegraded":"2024-05-09T08:02:30.360184+0000","last_fullsized":"2024-05-09T08:02:30.360184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'586","last_scrub_stamp":"2024-05-09T08:02:30.360087+0000","last_deep_scrub":"23'586","last_deep_scrub_stamp":"2024-05-09T08:02:30.360087+0000","last_clean_scrub_stamp":"2024-05-09T08:02:30.360087+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:38.593896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":3420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'619","reported_seq":647,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:35.529037+0000","last_change":"2024-05-09T08:02:35.529078+0000","last_active":"2024-05-09T08:02:35.529037+0000","last_peered":"2024-05-09T08:02:35.529037+0000","last_clean":"2024-05-09T08:02:35.529037+0000","last_became_active":"2024-05-09T07:54:37.113945+0000","last_became_peered":"2024-05-09T07:54:37.113945+0000","last_unstale":"2024-05-09T08:02:35.529037+0000","last_undegraded":"2024-05-09T08:02:35.529037+0000","last_fullsized":"2024-05-09T08:02:35.529037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'619","last_scrub_stamp":"2024-05-09T08:02:35.528927+0000","last_deep_scrub":"23'619","last_deep_scrub_stamp":"2024-05-09T08:02:35.528927+0000","last_clean_scrub_stamp":"2024-05-09T08:02:35.528927+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:49:36.991095+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":763,"num_write_kb":3539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'582","reported_seq":610,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:25.100294+0000","last_change":"2024-05-09T08:02:25.100343+0000","last_active":"2024-05-09T08:02:25.100294+0000","last_peered":"2024-05-09T08:02:25.100294+0000","last_clean":"2024-05-09T08:02:25.100294+0000","last_became_active":"2024-05-09T07:54:37.110594+0000","last_became_peered":"2024-05-09T07:54:37.110594+0000","last_unstale":"2024-05-09T08:02:25.100294+0000","last_undegraded":"2024-05-09T08:02:25.100294+0000","last_fullsized":"2024-05-09T08:02:25.100294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'582","last_scrub_stamp":"2024-05-09T08:02:25.100159+0000","last_deep_scrub":"23'582","last_deep_scrub_stamp":"2024-05-09T08:02:25.100159+0000","last_clean_scrub_stamp":"2024-05-09T08:02:25.100159+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:40.287805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":3532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'626","reported_seq":654,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:32.436285+0000","last_change":"2024-05-09T08:02:32.436310+0000","last_active":"2024-05-09T08:02:32.436285+0000","last_peered":"2024-05-09T08:02:32.436285+0000","last_clean":"2024-05-09T08:02:32.436285+0000","last_became_active":"2024-05-09T07:54:37.106440+0000","last_became_peered":"2024-05-09T07:54:37.106440+0000","last_unstale":"2024-05-09T08:02:32.436285+0000","last_undegraded":"2024-05-09T08:02:32.436285+0000","last_fullsized":"2024-05-09T08:02:32.436285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'626","last_scrub_stamp":"2024-05-09T08:02:32.436186+0000","last_deep_scrub":"23'626","last_deep_scrub_stamp":"2024-05-09T08:02:32.436186+0000","last_clean_scrub_stamp":"2024-05-09T08:02:32.436186+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:20:49.960019+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":762,"num_write_kb":3463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'591","reported_seq":619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:29.711874+0000","last_change":"2024-05-09T08:02:29.711900+0000","last_active":"2024-05-09T08:02:29.711874+0000","last_peered":"2024-05-09T08:02:29.711874+0000","last_clean":"2024-05-09T08:02:29.711874+0000","last_became_active":"2024-05-09T07:54:37.110672+0000","last_became_peered":"2024-05-09T07:54:37.110672+0000","last_unstale":"2024-05-09T08:02:29.711874+0000","last_undegraded":"2024-05-09T08:02:29.711874+0000","last_fullsized":"2024-05-09T08:02:29.711874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'591","last_scrub_stamp":"2024-05-09T08:02:29.711773+0000","last_deep_scrub":"23'591","last_deep_scrub_stamp":"2024-05-09T08:02:29.711773+0000","last_clean_scrub_stamp":"2024-05-09T08:02:29.711773+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:27.606467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":725,"num_write_kb":3173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'551","reported_seq":579,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:27.723120+0000","last_change":"2024-05-09T08:02:27.723149+0000","last_active":"2024-05-09T08:02:27.723120+0000","last_peered":"2024-05-09T08:02:27.723120+0000","last_clean":"2024-05-09T08:02:27.723120+0000","last_became_active":"2024-05-09T07:54:37.110143+0000","last_became_peered":"2024-05-09T07:54:37.110143+0000","last_unstale":"2024-05-09T08:02:27.723120+0000","last_undegraded":"2024-05-09T08:02:27.723120+0000","last_fullsized":"2024-05-09T08:02:27.723120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'551","last_scrub_stamp":"2024-05-09T08:02:27.723014+0000","last_deep_scrub":"23'551","last_deep_scrub_stamp":"2024-05-09T08:02:27.723014+0000","last_clean_scrub_stamp":"2024-05-09T08:02:27.723014+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:58.961823+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":683,"num_write_kb":3170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'545","reported_seq":573,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:20.741186+0000","last_change":"2024-05-09T08:02:20.741216+0000","last_active":"2024-05-09T08:02:20.741186+0000","last_peered":"2024-05-09T08:02:20.741186+0000","last_clean":"2024-05-09T08:02:20.741186+0000","last_became_active":"2024-05-09T07:54:37.102959+0000","last_became_peered":"2024-05-09T07:54:37.102959+0000","last_unstale":"2024-05-09T08:02:20.741186+0000","last_undegraded":"2024-05-09T08:02:20.741186+0000","last_fullsized":"2024-05-09T08:02:20.741186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'545","last_scrub_stamp":"2024-05-09T08:02:20.741087+0000","last_deep_scrub":"23'545","last_deep_scrub_stamp":"2024-05-09T08:02:20.741087+0000","last_clean_scrub_stamp":"2024-05-09T08:02:20.741087+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:55:18.590069+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":666,"num_write_kb":3023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'584","reported_seq":612,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:23.103511+0000","last_change":"2024-05-09T08:02:23.103538+0000","last_active":"2024-05-09T08:02:23.103511+0000","last_peered":"2024-05-09T08:02:23.103511+0000","last_clean":"2024-05-09T08:02:23.103511+0000","last_became_active":"2024-05-09T07:54:37.103651+0000","last_became_peered":"2024-05-09T07:54:37.103651+0000","last_unstale":"2024-05-09T08:02:23.103511+0000","last_undegraded":"2024-05-09T08:02:23.103511+0000","last_fullsized":"2024-05-09T08:02:23.103511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'584","last_scrub_stamp":"2024-05-09T08:02:23.103411+0000","last_deep_scrub":"23'584","last_deep_scrub_stamp":"2024-05-09T08:02:23.103411+0000","last_clean_scrub_stamp":"2024-05-09T08:02:23.103411+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:36.354715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":3698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'626","reported_seq":654,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:20.175842+0000","last_change":"2024-05-09T08:02:20.175878+0000","last_active":"2024-05-09T08:02:20.175842+0000","last_peered":"2024-05-09T08:02:20.175842+0000","last_clean":"2024-05-09T08:02:20.175842+0000","last_became_active":"2024-05-09T07:54:37.105408+0000","last_became_peered":"2024-05-09T07:54:37.105408+0000","last_unstale":"2024-05-09T08:02:20.175842+0000","last_undegraded":"2024-05-09T08:02:20.175842+0000","last_fullsized":"2024-05-09T08:02:20.175842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'626","last_scrub_stamp":"2024-05-09T08:02:20.175739+0000","last_deep_scrub":"23'626","last_deep_scrub_stamp":"2024-05-09T08:02:20.175739+0000","last_clean_scrub_stamp":"2024-05-09T08:02:20.175739+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:23.606762+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":764,"num_write_kb":3967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'617","reported_seq":645,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:22.209493+0000","last_change":"2024-05-09T08:02:22.209519+0000","last_active":"2024-05-09T08:02:22.209493+0000","last_peered":"2024-05-09T08:02:22.209493+0000","last_clean":"2024-05-09T08:02:22.209493+0000","last_became_active":"2024-05-09T07:54:37.090422+0000","last_became_peered":"2024-05-09T07:54:37.090422+0000","last_unstale":"2024-05-09T08:02:22.209493+0000","last_undegraded":"2024-05-09T08:02:22.209493+0000","last_fullsized":"2024-05-09T08:02:22.209493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'617","last_scrub_stamp":"2024-05-09T08:02:22.209403+0000","last_deep_scrub":"23'617","last_deep_scrub_stamp":"2024-05-09T08:02:22.209403+0000","last_clean_scrub_stamp":"2024-05-09T08:02:22.209403+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:37:59.435381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":749,"num_write_kb":3825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'651","reported_seq":679,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:31.334288+0000","last_change":"2024-05-09T08:02:31.334313+0000","last_active":"2024-05-09T08:02:31.334288+0000","last_peered":"2024-05-09T08:02:31.334288+0000","last_clean":"2024-05-09T08:02:31.334288+0000","last_became_active":"2024-05-09T07:54:37.110558+0000","last_became_peered":"2024-05-09T07:54:37.110558+0000","last_unstale":"2024-05-09T08:02:31.334288+0000","last_undegraded":"2024-05-09T08:02:31.334288+0000","last_fullsized":"2024-05-09T08:02:31.334288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'651","last_scrub_stamp":"2024-05-09T08:02:31.334186+0000","last_deep_scrub":"23'651","last_deep_scrub_stamp":"2024-05-09T08:02:31.334186+0000","last_clean_scrub_stamp":"2024-05-09T08:02:31.334186+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:01.544079+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":3733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'630","reported_seq":658,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:25.412431+0000","last_change":"2024-05-09T08:02:25.412458+0000","last_active":"2024-05-09T08:02:25.412431+0000","last_peered":"2024-05-09T08:02:25.412431+0000","last_clean":"2024-05-09T08:02:25.412431+0000","last_became_active":"2024-05-09T07:54:37.099232+0000","last_became_peered":"2024-05-09T07:54:37.099232+0000","last_unstale":"2024-05-09T08:02:25.412431+0000","last_undegraded":"2024-05-09T08:02:25.412431+0000","last_fullsized":"2024-05-09T08:02:25.412431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'630","last_scrub_stamp":"2024-05-09T08:02:25.412334+0000","last_deep_scrub":"23'630","last_deep_scrub_stamp":"2024-05-09T08:02:25.412334+0000","last_clean_scrub_stamp":"2024-05-09T08:02:25.412334+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:31.123560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":774,"num_write_kb":3592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'592","reported_seq":620,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:20.574025+0000","last_change":"2024-05-09T08:02:20.574052+0000","last_active":"2024-05-09T08:02:20.574025+0000","last_peered":"2024-05-09T08:02:20.574025+0000","last_clean":"2024-05-09T08:02:20.574025+0000","last_became_active":"2024-05-09T07:54:37.104788+0000","last_became_peered":"2024-05-09T07:54:37.104788+0000","last_unstale":"2024-05-09T08:02:20.574025+0000","last_undegraded":"2024-05-09T08:02:20.574025+0000","last_fullsized":"2024-05-09T08:02:20.574025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'592","last_scrub_stamp":"2024-05-09T08:02:20.573933+0000","last_deep_scrub":"23'592","last_deep_scrub_stamp":"2024-05-09T08:02:20.573933+0000","last_clean_scrub_stamp":"2024-05-09T08:02:20.573933+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:39:30.606391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'619","reported_seq":641,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:28.278101+0000","last_change":"2024-05-09T08:02:28.278144+0000","last_active":"2024-05-09T08:02:28.278101+0000","last_peered":"2024-05-09T08:02:28.278101+0000","last_clean":"2024-05-09T08:02:28.278101+0000","last_became_active":"2024-05-09T07:55:18.561115+0000","last_became_peered":"2024-05-09T07:55:18.561115+0000","last_unstale":"2024-05-09T08:02:28.278101+0000","last_undegraded":"2024-05-09T08:02:28.278101+0000","last_fullsized":"2024-05-09T08:02:28.278101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'619","last_scrub_stamp":"2024-05-09T08:02:28.277984+0000","last_deep_scrub":"23'619","last_deep_scrub_stamp":"2024-05-09T08:02:28.277984+0000","last_clean_scrub_stamp":"2024-05-09T08:02:28.277984+0000","objects_scrubbed":0,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:16.006934+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"23'657","reported_seq":685,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:28.720618+0000","last_change":"2024-05-09T08:02:28.720646+0000","last_active":"2024-05-09T08:02:28.720618+0000","last_peered":"2024-05-09T08:02:28.720618+0000","last_clean":"2024-05-09T08:02:28.720618+0000","last_became_active":"2024-05-09T07:54:37.110033+0000","last_became_peered":"2024-05-09T07:54:37.110033+0000","last_unstale":"2024-05-09T08:02:28.720618+0000","last_undegraded":"2024-05-09T08:02:28.720618+0000","last_fullsized":"2024-05-09T08:02:28.720618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'657","last_scrub_stamp":"2024-05-09T08:02:28.720515+0000","last_deep_scrub":"23'657","last_deep_scrub_stamp":"2024-05-09T08:02:28.720515+0000","last_clean_scrub_stamp":"2024-05-09T08:02:28.720515+0000","objects_scrubbed":0,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:45.035012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":801,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'610","reported_seq":638,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:24.263229+0000","last_change":"2024-05-09T08:02:24.263269+0000","last_active":"2024-05-09T08:02:24.263229+0000","last_peered":"2024-05-09T08:02:24.263229+0000","last_clean":"2024-05-09T08:02:24.263229+0000","last_became_active":"2024-05-09T07:54:37.108367+0000","last_became_peered":"2024-05-09T07:54:37.108367+0000","last_unstale":"2024-05-09T08:02:24.263229+0000","last_undegraded":"2024-05-09T08:02:24.263229+0000","last_fullsized":"2024-05-09T08:02:24.263229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'610","last_scrub_stamp":"2024-05-09T08:02:24.263110+0000","last_deep_scrub":"23'610","last_deep_scrub_stamp":"2024-05-09T08:02:24.263110+0000","last_clean_scrub_stamp":"2024-05-09T08:02:24.263110+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:38:01.489088+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":3681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'647","reported_seq":675,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:24.379963+0000","last_change":"2024-05-09T08:02:24.380014+0000","last_active":"2024-05-09T08:02:24.379963+0000","last_peered":"2024-05-09T08:02:24.379963+0000","last_clean":"2024-05-09T08:02:24.379963+0000","last_became_active":"2024-05-09T07:54:37.097821+0000","last_became_peered":"2024-05-09T07:54:37.097821+0000","last_unstale":"2024-05-09T08:02:24.379963+0000","last_undegraded":"2024-05-09T08:02:24.379963+0000","last_fullsized":"2024-05-09T08:02:24.379963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'647","last_scrub_stamp":"2024-05-09T08:02:24.379840+0000","last_deep_scrub":"23'647","last_deep_scrub_stamp":"2024-05-09T08:02:24.379840+0000","last_clean_scrub_stamp":"2024-05-09T08:02:24.379840+0000","objects_scrubbed":0,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:34.909878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":798,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'606","reported_seq":634,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:27.023366+0000","last_change":"2024-05-09T08:02:27.023410+0000","last_active":"2024-05-09T08:02:27.023366+0000","last_peered":"2024-05-09T08:02:27.023366+0000","last_clean":"2024-05-09T08:02:27.023366+0000","last_became_active":"2024-05-09T07:54:37.112008+0000","last_became_peered":"2024-05-09T07:54:37.112008+0000","last_unstale":"2024-05-09T08:02:27.023366+0000","last_undegraded":"2024-05-09T08:02:27.023366+0000","last_fullsized":"2024-05-09T08:02:27.023366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'606","last_scrub_stamp":"2024-05-09T08:02:27.023235+0000","last_deep_scrub":"23'606","last_deep_scrub_stamp":"2024-05-09T08:02:27.023235+0000","last_clean_scrub_stamp":"2024-05-09T08:02:27.023235+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:32.734462+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":3749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'666","reported_seq":694,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:26.410420+0000","last_change":"2024-05-09T08:02:26.410465+0000","last_active":"2024-05-09T08:02:26.410420+0000","last_peered":"2024-05-09T08:02:26.410420+0000","last_clean":"2024-05-09T08:02:26.410420+0000","last_became_active":"2024-05-09T07:54:37.102459+0000","last_became_peered":"2024-05-09T07:54:37.102459+0000","last_unstale":"2024-05-09T08:02:26.410420+0000","last_undegraded":"2024-05-09T08:02:26.410420+0000","last_fullsized":"2024-05-09T08:02:26.410420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'666","last_scrub_stamp":"2024-05-09T08:02:26.410322+0000","last_deep_scrub":"23'666","last_deep_scrub_stamp":"2024-05-09T08:02:26.410322+0000","last_clean_scrub_stamp":"2024-05-09T08:02:26.410322+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:14.868943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":3958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'636","reported_seq":664,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:21.079264+0000","last_change":"2024-05-09T08:02:21.079305+0000","last_active":"2024-05-09T08:02:21.079264+0000","last_peered":"2024-05-09T08:02:21.079264+0000","last_clean":"2024-05-09T08:02:21.079264+0000","last_became_active":"2024-05-09T07:54:37.100737+0000","last_became_peered":"2024-05-09T07:54:37.100737+0000","last_unstale":"2024-05-09T08:02:21.079264+0000","last_undegraded":"2024-05-09T08:02:21.079264+0000","last_fullsized":"2024-05-09T08:02:21.079264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'636","last_scrub_stamp":"2024-05-09T08:02:21.079148+0000","last_deep_scrub":"23'636","last_deep_scrub_stamp":"2024-05-09T08:02:21.079148+0000","last_clean_scrub_stamp":"2024-05-09T08:02:21.079148+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:37:58.305126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":4000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"23'718","reported_seq":746,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:23.771352+0000","last_change":"2024-05-09T08:02:23.771379+0000","last_active":"2024-05-09T08:02:23.771352+0000","last_peered":"2024-05-09T08:02:23.771352+0000","last_clean":"2024-05-09T08:02:23.771352+0000","last_became_active":"2024-05-09T07:54:37.106249+0000","last_became_peered":"2024-05-09T07:54:37.106249+0000","last_unstale":"2024-05-09T08:02:23.771352+0000","last_undegraded":"2024-05-09T08:02:23.771352+0000","last_fullsized":"2024-05-09T08:02:23.771352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'718","last_scrub_stamp":"2024-05-09T08:02:23.771252+0000","last_deep_scrub":"23'718","last_deep_scrub_stamp":"2024-05-09T08:02:23.771252+0000","last_clean_scrub_stamp":"2024-05-09T08:02:23.771252+0000","objects_scrubbed":0,"log_size":718,"log_dups_size":0,"ondisk_log_size":718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:18:13.083407+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":4031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'618","reported_seq":646,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:23.257071+0000","last_change":"2024-05-09T08:02:23.257098+0000","last_active":"2024-05-09T08:02:23.257071+0000","last_peered":"2024-05-09T08:02:23.257071+0000","last_clean":"2024-05-09T08:02:23.257071+0000","last_became_active":"2024-05-09T07:54:37.101204+0000","last_became_peered":"2024-05-09T07:54:37.101204+0000","last_unstale":"2024-05-09T08:02:23.257071+0000","last_undegraded":"2024-05-09T08:02:23.257071+0000","last_fullsized":"2024-05-09T08:02:23.257071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'618","last_scrub_stamp":"2024-05-09T08:02:23.256980+0000","last_deep_scrub":"23'618","last_deep_scrub_stamp":"2024-05-09T08:02:23.256980+0000","last_clean_scrub_stamp":"2024-05-09T08:02:23.256980+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:52.682925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'588","reported_seq":616,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:28.018457+0000","last_change":"2024-05-09T08:02:28.018485+0000","last_active":"2024-05-09T08:02:28.018457+0000","last_peered":"2024-05-09T08:02:28.018457+0000","last_clean":"2024-05-09T08:02:28.018457+0000","last_became_active":"2024-05-09T07:54:37.112651+0000","last_became_peered":"2024-05-09T07:54:37.112651+0000","last_unstale":"2024-05-09T08:02:28.018457+0000","last_undegraded":"2024-05-09T08:02:28.018457+0000","last_fullsized":"2024-05-09T08:02:28.018457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'588","last_scrub_stamp":"2024-05-09T08:02:28.018347+0000","last_deep_scrub":"23'588","last_deep_scrub_stamp":"2024-05-09T08:02:28.018347+0000","last_clean_scrub_stamp":"2024-05-09T08:02:28.018347+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:16.476968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":3451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'618","reported_seq":646,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:26.323924+0000","last_change":"2024-05-09T08:02:26.323954+0000","last_active":"2024-05-09T08:02:26.323924+0000","last_peered":"2024-05-09T08:02:26.323924+0000","last_clean":"2024-05-09T08:02:26.323924+0000","last_became_active":"2024-05-09T07:54:37.108057+0000","last_became_peered":"2024-05-09T07:54:37.108057+0000","last_unstale":"2024-05-09T08:02:26.323924+0000","last_undegraded":"2024-05-09T08:02:26.323924+0000","last_fullsized":"2024-05-09T08:02:26.323924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'618","last_scrub_stamp":"2024-05-09T08:02:26.323826+0000","last_deep_scrub":"23'618","last_deep_scrub_stamp":"2024-05-09T08:02:26.323826+0000","last_clean_scrub_stamp":"2024-05-09T08:02:26.323826+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:39.575130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":754,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'697","reported_seq":725,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:27.381179+0000","last_change":"2024-05-09T08:02:27.381204+0000","last_active":"2024-05-09T08:02:27.381179+0000","last_peered":"2024-05-09T08:02:27.381179+0000","last_clean":"2024-05-09T08:02:27.381179+0000","last_became_active":"2024-05-09T07:54:37.102818+0000","last_became_peered":"2024-05-09T07:54:37.102818+0000","last_unstale":"2024-05-09T08:02:27.381179+0000","last_undegraded":"2024-05-09T08:02:27.381179+0000","last_fullsized":"2024-05-09T08:02:27.381179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'697","last_scrub_stamp":"2024-05-09T08:02:27.381005+0000","last_deep_scrub":"23'697","last_deep_scrub_stamp":"2024-05-09T08:02:27.381005+0000","last_clean_scrub_stamp":"2024-05-09T08:02:27.381005+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:28.928722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":843,"num_write_kb":3831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'687","reported_seq":715,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:21.605340+0000","last_change":"2024-05-09T08:02:21.605400+0000","last_active":"2024-05-09T08:02:21.605340+0000","last_peered":"2024-05-09T08:02:21.605340+0000","last_clean":"2024-05-09T08:02:21.605340+0000","last_became_active":"2024-05-09T07:54:37.109364+0000","last_became_peered":"2024-05-09T07:54:37.109364+0000","last_unstale":"2024-05-09T08:02:21.605340+0000","last_undegraded":"2024-05-09T08:02:21.605340+0000","last_fullsized":"2024-05-09T08:02:21.605340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'687","last_scrub_stamp":"2024-05-09T08:02:21.605236+0000","last_deep_scrub":"23'687","last_deep_scrub_stamp":"2024-05-09T08:02:21.605236+0000","last_clean_scrub_stamp":"2024-05-09T08:02:21.605236+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:04:58.804147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":853,"num_write_kb":4238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'658","reported_seq":686,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:26.718115+0000","last_change":"2024-05-09T08:02:26.718139+0000","last_active":"2024-05-09T08:02:26.718115+0000","last_peered":"2024-05-09T08:02:26.718115+0000","last_clean":"2024-05-09T08:02:26.718115+0000","last_became_active":"2024-05-09T07:54:37.111025+0000","last_became_peered":"2024-05-09T07:54:37.111025+0000","last_unstale":"2024-05-09T08:02:26.718115+0000","last_undegraded":"2024-05-09T08:02:26.718115+0000","last_fullsized":"2024-05-09T08:02:26.718115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'658","last_scrub_stamp":"2024-05-09T08:02:26.718021+0000","last_deep_scrub":"23'658","last_deep_scrub_stamp":"2024-05-09T08:02:26.718021+0000","last_clean_scrub_stamp":"2024-05-09T08:02:26.718021+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:11:57.405052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":803,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'616","reported_seq":644,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:19.788259+0000","last_change":"2024-05-09T08:02:19.788284+0000","last_active":"2024-05-09T08:02:19.788259+0000","last_peered":"2024-05-09T08:02:19.788259+0000","last_clean":"2024-05-09T08:02:19.788259+0000","last_became_active":"2024-05-09T07:54:37.099258+0000","last_became_peered":"2024-05-09T07:54:37.099258+0000","last_unstale":"2024-05-09T08:02:19.788259+0000","last_undegraded":"2024-05-09T08:02:19.788259+0000","last_fullsized":"2024-05-09T08:02:19.788259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'616","last_scrub_stamp":"2024-05-09T08:02:19.788170+0000","last_deep_scrub":"23'616","last_deep_scrub_stamp":"2024-05-09T08:02:19.788170+0000","last_clean_scrub_stamp":"2024-05-09T08:02:19.788170+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:46:01.022693+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":770,"num_write_kb":3676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"23'432","reported_seq":462,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:19.056846+0000","last_change":"2024-05-09T08:02:19.056867+0000","last_active":"2024-05-09T08:02:19.056846+0000","last_peered":"2024-05-09T08:02:19.056846+0000","last_clean":"2024-05-09T08:02:19.056846+0000","last_became_active":"2024-05-09T07:54:36.105183+0000","last_became_peered":"2024-05-09T07:54:36.105183+0000","last_unstale":"2024-05-09T08:02:19.056846+0000","last_undegraded":"2024-05-09T08:02:19.056846+0000","last_fullsized":"2024-05-09T08:02:19.056846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'432","last_scrub_stamp":"2024-05-09T08:02:19.056754+0000","last_deep_scrub":"23'432","last_deep_scrub_stamp":"2024-05-09T08:02:19.056754+0000","last_clean_scrub_stamp":"2024-05-09T08:02:19.056754+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:18:08.368909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":480,"num_write_kb":8805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'556","reported_seq":584,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:27.353369+0000","last_change":"2024-05-09T08:02:27.353396+0000","last_active":"2024-05-09T08:02:27.353369+0000","last_peered":"2024-05-09T08:02:27.353369+0000","last_clean":"2024-05-09T08:02:27.353369+0000","last_became_active":"2024-05-09T07:54:37.109242+0000","last_became_peered":"2024-05-09T07:54:37.109242+0000","last_unstale":"2024-05-09T08:02:27.353369+0000","last_undegraded":"2024-05-09T08:02:27.353369+0000","last_fullsized":"2024-05-09T08:02:27.353369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'556","last_scrub_stamp":"2024-05-09T08:02:27.353252+0000","last_deep_scrub":"23'556","last_deep_scrub_stamp":"2024-05-09T08:02:27.353252+0000","last_clean_scrub_stamp":"2024-05-09T08:02:27.353252+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:39.826584+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":668,"num_write_kb":3012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"23'951","reported_seq":981,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:18.788904+0000","last_change":"2024-05-09T08:02:18.788931+0000","last_active":"2024-05-09T08:02:18.788904+0000","last_peered":"2024-05-09T08:02:18.788904+0000","last_clean":"2024-05-09T08:02:18.788904+0000","last_became_active":"2024-05-09T07:54:36.099204+0000","last_became_peered":"2024-05-09T07:54:36.099204+0000","last_unstale":"2024-05-09T08:02:18.788904+0000","last_undegraded":"2024-05-09T08:02:18.788904+0000","last_fullsized":"2024-05-09T08:02:18.788904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'951","last_scrub_stamp":"2024-05-09T08:02:18.788820+0000","last_deep_scrub":"23'951","last_deep_scrub_stamp":"2024-05-09T08:02:18.788820+0000","last_clean_scrub_stamp":"2024-05-09T08:02:18.788820+0000","objects_scrubbed":1,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:04:55.987732+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":1015,"num_write_kb":29485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"23'177","reported_seq":207,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:18.080860+0000","last_change":"2024-05-09T08:02:18.080903+0000","last_active":"2024-05-09T08:02:18.080860+0000","last_peered":"2024-05-09T08:02:18.080860+0000","last_clean":"2024-05-09T08:02:18.080860+0000","last_became_active":"2024-05-09T07:54:36.103114+0000","last_became_peered":"2024-05-09T07:54:36.103114+0000","last_unstale":"2024-05-09T08:02:18.080860+0000","last_undegraded":"2024-05-09T08:02:18.080860+0000","last_fullsized":"2024-05-09T08:02:18.080860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'177","last_scrub_stamp":"2024-05-09T08:02:18.080750+0000","last_deep_scrub":"23'177","last_deep_scrub_stamp":"2024-05-09T08:02:18.080750+0000","last_clean_scrub_stamp":"2024-05-09T08:02:18.080750+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:30.462597+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":217,"num_write_kb":8642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'671","reported_seq":699,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:29.022095+0000","last_change":"2024-05-09T08:02:29.022128+0000","last_active":"2024-05-09T08:02:29.022095+0000","last_peered":"2024-05-09T08:02:29.022095+0000","last_clean":"2024-05-09T08:02:29.022095+0000","last_became_active":"2024-05-09T07:54:37.113293+0000","last_became_peered":"2024-05-09T07:54:37.113293+0000","last_unstale":"2024-05-09T08:02:29.022095+0000","last_undegraded":"2024-05-09T08:02:29.022095+0000","last_fullsized":"2024-05-09T08:02:29.022095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'671","last_scrub_stamp":"2024-05-09T08:02:29.022004+0000","last_deep_scrub":"23'671","last_deep_scrub_stamp":"2024-05-09T08:02:29.022004+0000","last_clean_scrub_stamp":"2024-05-09T08:02:29.022004+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:28.837432+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"23'714","reported_seq":744,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:18.474948+0000","last_change":"2024-05-09T08:02:18.474984+0000","last_active":"2024-05-09T08:02:18.474948+0000","last_peered":"2024-05-09T08:02:18.474948+0000","last_clean":"2024-05-09T08:02:18.474948+0000","last_became_active":"2024-05-09T07:54:36.090950+0000","last_became_peered":"2024-05-09T07:54:36.090950+0000","last_unstale":"2024-05-09T08:02:18.474948+0000","last_undegraded":"2024-05-09T08:02:18.474948+0000","last_fullsized":"2024-05-09T08:02:18.474948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'714","last_scrub_stamp":"2024-05-09T08:02:18.474852+0000","last_deep_scrub":"23'714","last_deep_scrub_stamp":"2024-05-09T08:02:18.474852+0000","last_clean_scrub_stamp":"2024-05-09T08:02:18.474852+0000","objects_scrubbed":4,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:14.946522+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":749,"num_write_kb":37565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'621","reported_seq":649,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:25.215209+0000","last_change":"2024-05-09T08:02:25.215237+0000","last_active":"2024-05-09T08:02:25.215209+0000","last_peered":"2024-05-09T08:02:25.215209+0000","last_clean":"2024-05-09T08:02:25.215209+0000","last_became_active":"2024-05-09T07:54:37.106014+0000","last_became_peered":"2024-05-09T07:54:37.106014+0000","last_unstale":"2024-05-09T08:02:25.215209+0000","last_undegraded":"2024-05-09T08:02:25.215209+0000","last_fullsized":"2024-05-09T08:02:25.215209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'621","last_scrub_stamp":"2024-05-09T08:02:25.215104+0000","last_deep_scrub":"23'621","last_deep_scrub_stamp":"2024-05-09T08:02:25.215104+0000","last_clean_scrub_stamp":"2024-05-09T08:02:25.215104+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:26:23.109798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":3585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'142","reported_seq":172,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:19.779323+0000","last_change":"2024-05-09T08:02:19.779361+0000","last_active":"2024-05-09T08:02:19.779323+0000","last_peered":"2024-05-09T08:02:19.779323+0000","last_clean":"2024-05-09T08:02:19.779323+0000","last_became_active":"2024-05-09T07:54:36.099098+0000","last_became_peered":"2024-05-09T07:54:36.099098+0000","last_unstale":"2024-05-09T08:02:19.779323+0000","last_undegraded":"2024-05-09T08:02:19.779323+0000","last_fullsized":"2024-05-09T08:02:19.779323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'142","last_scrub_stamp":"2024-05-09T08:02:19.779222+0000","last_deep_scrub":"23'142","last_deep_scrub_stamp":"2024-05-09T08:02:19.779222+0000","last_clean_scrub_stamp":"2024-05-09T08:02:19.779222+0000","objects_scrubbed":3,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:54:13.821895+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10381600,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":185,"num_write_kb":10398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'661","reported_seq":683,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:24.672540+0000","last_change":"2024-05-09T08:02:24.672540+0000","last_active":"2024-05-09T08:02:24.672540+0000","last_peered":"2024-05-09T08:02:24.672540+0000","last_clean":"2024-05-09T08:02:24.672540+0000","last_became_active":"2024-05-09T07:55:18.902706+0000","last_became_peered":"2024-05-09T07:55:18.902706+0000","last_unstale":"2024-05-09T08:02:24.672540+0000","last_undegraded":"2024-05-09T08:02:24.672540+0000","last_fullsized":"2024-05-09T08:02:24.672540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'661","last_scrub_stamp":"2024-05-09T08:02:24.672414+0000","last_deep_scrub":"23'661","last_deep_scrub_stamp":"2024-05-09T08:02:24.672414+0000","last_clean_scrub_stamp":"2024-05-09T08:02:24.672414+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:32:09.946774+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":822,"num_write_kb":4312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"23'444","reported_seq":474,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:20.379330+0000","last_change":"2024-05-09T08:02:20.379391+0000","last_active":"2024-05-09T08:02:20.379330+0000","last_peered":"2024-05-09T08:02:20.379330+0000","last_clean":"2024-05-09T08:02:20.379330+0000","last_became_active":"2024-05-09T07:54:36.100059+0000","last_became_peered":"2024-05-09T07:54:36.100059+0000","last_unstale":"2024-05-09T08:02:20.379330+0000","last_undegraded":"2024-05-09T08:02:20.379330+0000","last_fullsized":"2024-05-09T08:02:20.379330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'444","last_scrub_stamp":"2024-05-09T08:02:20.379214+0000","last_deep_scrub":"23'444","last_deep_scrub_stamp":"2024-05-09T08:02:20.379214+0000","last_clean_scrub_stamp":"2024-05-09T08:02:20.379214+0000","objects_scrubbed":1,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:11:51.066245+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":490,"num_write_kb":25148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'591","reported_seq":619,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:22.229962+0000","last_change":"2024-05-09T08:02:22.229987+0000","last_active":"2024-05-09T08:02:22.229962+0000","last_peered":"2024-05-09T08:02:22.229962+0000","last_clean":"2024-05-09T08:02:22.229962+0000","last_became_active":"2024-05-09T07:54:37.107246+0000","last_became_peered":"2024-05-09T07:54:37.107246+0000","last_unstale":"2024-05-09T08:02:22.229962+0000","last_undegraded":"2024-05-09T08:02:22.229962+0000","last_fullsized":"2024-05-09T08:02:22.229962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'591","last_scrub_stamp":"2024-05-09T08:02:22.229867+0000","last_deep_scrub":"23'591","last_deep_scrub_stamp":"2024-05-09T08:02:22.229867+0000","last_clean_scrub_stamp":"2024-05-09T08:02:22.229867+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:31.974025+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'770","reported_seq":800,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:18.179607+0000","last_change":"2024-05-09T08:02:18.179638+0000","last_active":"2024-05-09T08:02:18.179607+0000","last_peered":"2024-05-09T08:02:18.179607+0000","last_clean":"2024-05-09T08:02:18.179607+0000","last_became_active":"2024-05-09T07:54:36.101400+0000","last_became_peered":"2024-05-09T07:54:36.101400+0000","last_unstale":"2024-05-09T08:02:18.179607+0000","last_undegraded":"2024-05-09T08:02:18.179607+0000","last_fullsized":"2024-05-09T08:02:18.179607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'770","last_scrub_stamp":"2024-05-09T08:02:18.179529+0000","last_deep_scrub":"23'770","last_deep_scrub_stamp":"2024-05-09T08:02:18.179529+0000","last_clean_scrub_stamp":"2024-05-09T08:02:18.179529+0000","objects_scrubbed":3,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:32:03.453889+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":817,"num_write_kb":21310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'594","reported_seq":622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:18.762094+0000","last_change":"2024-05-09T08:02:18.762120+0000","last_active":"2024-05-09T08:02:18.762094+0000","last_peered":"2024-05-09T08:02:18.762094+0000","last_clean":"2024-05-09T08:02:18.762094+0000","last_became_active":"2024-05-09T07:54:37.098459+0000","last_became_peered":"2024-05-09T07:54:37.098459+0000","last_unstale":"2024-05-09T08:02:18.762094+0000","last_undegraded":"2024-05-09T08:02:18.762094+0000","last_fullsized":"2024-05-09T08:02:18.762094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'594","last_scrub_stamp":"2024-05-09T08:02:18.761997+0000","last_deep_scrub":"23'594","last_deep_scrub_stamp":"2024-05-09T08:02:18.761997+0000","last_clean_scrub_stamp":"2024-05-09T08:02:18.761997+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:12:01.326271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'824","reported_seq":854,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:20.802435+0000","last_change":"2024-05-09T08:02:20.802471+0000","last_active":"2024-05-09T08:02:20.802435+0000","last_peered":"2024-05-09T08:02:20.802435+0000","last_clean":"2024-05-09T08:02:20.802435+0000","last_became_active":"2024-05-09T07:54:36.102770+0000","last_became_peered":"2024-05-09T07:54:36.102770+0000","last_unstale":"2024-05-09T08:02:20.802435+0000","last_undegraded":"2024-05-09T08:02:20.802435+0000","last_fullsized":"2024-05-09T08:02:20.802435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'824","last_scrub_stamp":"2024-05-09T08:02:20.802353+0000","last_deep_scrub":"23'824","last_deep_scrub_stamp":"2024-05-09T08:02:20.802353+0000","last_clean_scrub_stamp":"2024-05-09T08:02:20.802353+0000","objects_scrubbed":4,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:44:33.891450+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":851,"num_write_kb":25125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'612","reported_seq":640,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:28.456518+0000","last_change":"2024-05-09T08:02:28.456568+0000","last_active":"2024-05-09T08:02:28.456518+0000","last_peered":"2024-05-09T08:02:28.456518+0000","last_clean":"2024-05-09T08:02:28.456518+0000","last_became_active":"2024-05-09T07:54:37.101626+0000","last_became_peered":"2024-05-09T07:54:37.101626+0000","last_unstale":"2024-05-09T08:02:28.456518+0000","last_undegraded":"2024-05-09T08:02:28.456518+0000","last_fullsized":"2024-05-09T08:02:28.456518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'612","last_scrub_stamp":"2024-05-09T08:02:28.456422+0000","last_deep_scrub":"23'612","last_deep_scrub_stamp":"2024-05-09T08:02:28.456422+0000","last_clean_scrub_stamp":"2024-05-09T08:02:28.456422+0000","objects_scrubbed":0,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:47:03.657711+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":3775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'705","reported_seq":735,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:16.161576+0000","last_change":"2024-05-09T08:02:16.161607+0000","last_active":"2024-05-09T08:02:16.161576+0000","last_peered":"2024-05-09T08:02:16.161576+0000","last_clean":"2024-05-09T08:02:16.161576+0000","last_became_active":"2024-05-09T07:54:36.090671+0000","last_became_peered":"2024-05-09T07:54:36.090671+0000","last_unstale":"2024-05-09T08:02:16.161576+0000","last_undegraded":"2024-05-09T08:02:16.161576+0000","last_fullsized":"2024-05-09T08:02:16.161576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'705","last_scrub_stamp":"2024-05-09T08:02:16.161507+0000","last_deep_scrub":"23'705","last_deep_scrub_stamp":"2024-05-09T08:02:16.161507+0000","last_clean_scrub_stamp":"2024-05-09T08:02:16.161507+0000","objects_scrubbed":3,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:20:18.158456+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":750,"num_write_kb":17016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'628","reported_seq":656,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:19.174673+0000","last_change":"2024-05-09T08:02:19.174695+0000","last_active":"2024-05-09T08:02:19.174673+0000","last_peered":"2024-05-09T08:02:19.174673+0000","last_clean":"2024-05-09T08:02:19.174673+0000","last_became_active":"2024-05-09T07:54:37.105109+0000","last_became_peered":"2024-05-09T07:54:37.105109+0000","last_unstale":"2024-05-09T08:02:19.174673+0000","last_undegraded":"2024-05-09T08:02:19.174673+0000","last_fullsized":"2024-05-09T08:02:19.174673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'628","last_scrub_stamp":"2024-05-09T08:02:19.174593+0000","last_deep_scrub":"23'628","last_deep_scrub_stamp":"2024-05-09T08:02:19.174593+0000","last_clean_scrub_stamp":"2024-05-09T08:02:19.174593+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:02:53.068007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":3714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"23'74","reported_seq":104,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:22.326325+0000","last_change":"2024-05-09T08:02:22.326352+0000","last_active":"2024-05-09T08:02:22.326325+0000","last_peered":"2024-05-09T08:02:22.326325+0000","last_clean":"2024-05-09T08:02:22.326325+0000","last_became_active":"2024-05-09T07:54:36.102223+0000","last_became_peered":"2024-05-09T07:54:36.102223+0000","last_unstale":"2024-05-09T08:02:22.326325+0000","last_undegraded":"2024-05-09T08:02:22.326325+0000","last_fullsized":"2024-05-09T08:02:22.326325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-05-09T08:02:22.326230+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-05-09T08:02:22.326230+0000","last_clean_scrub_stamp":"2024-05-09T08:02:22.326230+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:34.799562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":148,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'603","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:31.462798+0000","last_change":"2024-05-09T08:02:31.462824+0000","last_active":"2024-05-09T08:02:31.462798+0000","last_peered":"2024-05-09T08:02:31.462798+0000","last_clean":"2024-05-09T08:02:31.462798+0000","last_became_active":"2024-05-09T07:54:37.104754+0000","last_became_peered":"2024-05-09T07:54:37.104754+0000","last_unstale":"2024-05-09T08:02:31.462798+0000","last_undegraded":"2024-05-09T08:02:31.462798+0000","last_fullsized":"2024-05-09T08:02:31.462798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'603","last_scrub_stamp":"2024-05-09T08:02:31.462699+0000","last_deep_scrub":"23'603","last_deep_scrub_stamp":"2024-05-09T08:02:31.462699+0000","last_clean_scrub_stamp":"2024-05-09T08:02:31.462699+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:48:01.672592+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":3484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"23'102","reported_seq":132,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:21.791348+0000","last_change":"2024-05-09T08:02:21.791375+0000","last_active":"2024-05-09T08:02:21.791348+0000","last_peered":"2024-05-09T08:02:21.791348+0000","last_clean":"2024-05-09T08:02:21.791348+0000","last_became_active":"2024-05-09T07:54:36.103437+0000","last_became_peered":"2024-05-09T07:54:36.103437+0000","last_unstale":"2024-05-09T08:02:21.791348+0000","last_undegraded":"2024-05-09T08:02:21.791348+0000","last_fullsized":"2024-05-09T08:02:21.791348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'102","last_scrub_stamp":"2024-05-09T08:02:21.791261+0000","last_deep_scrub":"23'102","last_deep_scrub_stamp":"2024-05-09T08:02:21.791261+0000","last_clean_scrub_stamp":"2024-05-09T08:02:21.791261+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:25.222284+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":161,"num_write_kb":4497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'724","reported_seq":752,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:25.730027+0000","last_change":"2024-05-09T08:02:25.730057+0000","last_active":"2024-05-09T08:02:25.730027+0000","last_peered":"2024-05-09T08:02:25.730027+0000","last_clean":"2024-05-09T08:02:25.730027+0000","last_became_active":"2024-05-09T07:54:37.110928+0000","last_became_peered":"2024-05-09T07:54:37.110928+0000","last_unstale":"2024-05-09T08:02:25.730027+0000","last_undegraded":"2024-05-09T08:02:25.730027+0000","last_fullsized":"2024-05-09T08:02:25.730027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'724","last_scrub_stamp":"2024-05-09T08:02:25.729917+0000","last_deep_scrub":"23'724","last_deep_scrub_stamp":"2024-05-09T08:02:25.729917+0000","last_clean_scrub_stamp":"2024-05-09T08:02:25.729917+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:18:05.921907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":3636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'188","reported_seq":218,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:17.557401+0000","last_change":"2024-05-09T08:02:17.557433+0000","last_active":"2024-05-09T08:02:17.557401+0000","last_peered":"2024-05-09T08:02:17.557401+0000","last_clean":"2024-05-09T08:02:17.557401+0000","last_became_active":"2024-05-09T07:54:36.098351+0000","last_became_peered":"2024-05-09T07:54:36.098351+0000","last_unstale":"2024-05-09T08:02:17.557401+0000","last_undegraded":"2024-05-09T08:02:17.557401+0000","last_fullsized":"2024-05-09T08:02:17.557401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'188","last_scrub_stamp":"2024-05-09T08:02:17.557335+0000","last_deep_scrub":"23'188","last_deep_scrub_stamp":"2024-05-09T08:02:17.557335+0000","last_clean_scrub_stamp":"2024-05-09T08:02:17.557335+0000","objects_scrubbed":5,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:06:04.445909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":241,"num_write_kb":8581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'724","reported_seq":752,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:29.447081+0000","last_change":"2024-05-09T08:02:29.447108+0000","last_active":"2024-05-09T08:02:29.447081+0000","last_peered":"2024-05-09T08:02:29.447081+0000","last_clean":"2024-05-09T08:02:29.447081+0000","last_became_active":"2024-05-09T07:54:37.102514+0000","last_became_peered":"2024-05-09T07:54:37.102514+0000","last_unstale":"2024-05-09T08:02:29.447081+0000","last_undegraded":"2024-05-09T08:02:29.447081+0000","last_fullsized":"2024-05-09T08:02:29.447081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'724","last_scrub_stamp":"2024-05-09T08:02:29.446992+0000","last_deep_scrub":"23'724","last_deep_scrub_stamp":"2024-05-09T08:02:29.446992+0000","last_clean_scrub_stamp":"2024-05-09T08:02:29.446992+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:48.368645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":3956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'290","reported_seq":320,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:17.763489+0000","last_change":"2024-05-09T08:02:17.763522+0000","last_active":"2024-05-09T08:02:17.763489+0000","last_peered":"2024-05-09T08:02:17.763489+0000","last_clean":"2024-05-09T08:02:17.763489+0000","last_became_active":"2024-05-09T07:54:36.091877+0000","last_became_peered":"2024-05-09T07:54:36.091877+0000","last_unstale":"2024-05-09T08:02:17.763489+0000","last_undegraded":"2024-05-09T08:02:17.763489+0000","last_fullsized":"2024-05-09T08:02:17.763489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'290","last_scrub_stamp":"2024-05-09T08:02:17.763374+0000","last_deep_scrub":"23'290","last_deep_scrub_stamp":"2024-05-09T08:02:17.763374+0000","last_clean_scrub_stamp":"2024-05-09T08:02:17.763374+0000","objects_scrubbed":1,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:06.997347+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":360,"num_write_kb":8736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'586","reported_seq":614,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:27.447047+0000","last_change":"2024-05-09T08:02:27.447073+0000","last_active":"2024-05-09T08:02:27.447047+0000","last_peered":"2024-05-09T08:02:27.447047+0000","last_clean":"2024-05-09T08:02:27.447047+0000","last_became_active":"2024-05-09T07:54:37.099861+0000","last_became_peered":"2024-05-09T07:54:37.099861+0000","last_unstale":"2024-05-09T08:02:27.447047+0000","last_undegraded":"2024-05-09T08:02:27.447047+0000","last_fullsized":"2024-05-09T08:02:27.447047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'586","last_scrub_stamp":"2024-05-09T08:02:27.446961+0000","last_deep_scrub":"23'586","last_deep_scrub_stamp":"2024-05-09T08:02:27.446961+0000","last_clean_scrub_stamp":"2024-05-09T08:02:27.446961+0000","objects_scrubbed":0,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:28.994678+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":3597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'317","reported_seq":347,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:18.517051+0000","last_change":"2024-05-09T08:02:18.517096+0000","last_active":"2024-05-09T08:02:18.517051+0000","last_peered":"2024-05-09T08:02:18.517051+0000","last_clean":"2024-05-09T08:02:18.517051+0000","last_became_active":"2024-05-09T07:54:36.099532+0000","last_became_peered":"2024-05-09T07:54:36.099532+0000","last_unstale":"2024-05-09T08:02:18.517051+0000","last_undegraded":"2024-05-09T08:02:18.517051+0000","last_fullsized":"2024-05-09T08:02:18.517051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'317","last_scrub_stamp":"2024-05-09T08:02:18.516970+0000","last_deep_scrub":"23'317","last_deep_scrub_stamp":"2024-05-09T08:02:18.516970+0000","last_clean_scrub_stamp":"2024-05-09T08:02:18.516970+0000","objects_scrubbed":1,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:55:16.365952+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":351,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'580","reported_seq":608,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:19.506073+0000","last_change":"2024-05-09T08:02:19.506098+0000","last_active":"2024-05-09T08:02:19.506073+0000","last_peered":"2024-05-09T08:02:19.506073+0000","last_clean":"2024-05-09T08:02:19.506073+0000","last_became_active":"2024-05-09T07:54:37.100617+0000","last_became_peered":"2024-05-09T07:54:37.100617+0000","last_unstale":"2024-05-09T08:02:19.506073+0000","last_undegraded":"2024-05-09T08:02:19.506073+0000","last_fullsized":"2024-05-09T08:02:19.506073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'580","last_scrub_stamp":"2024-05-09T08:02:19.505985+0000","last_deep_scrub":"23'580","last_deep_scrub_stamp":"2024-05-09T08:02:19.505985+0000","last_clean_scrub_stamp":"2024-05-09T08:02:19.505985+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:39.702545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":740,"num_write_kb":3520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'465","reported_seq":495,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:16.271457+0000","last_change":"2024-05-09T08:02:16.271485+0000","last_active":"2024-05-09T08:02:16.271457+0000","last_peered":"2024-05-09T08:02:16.271457+0000","last_clean":"2024-05-09T08:02:16.271457+0000","last_became_active":"2024-05-09T07:54:36.099311+0000","last_became_peered":"2024-05-09T07:54:36.099311+0000","last_unstale":"2024-05-09T08:02:16.271457+0000","last_undegraded":"2024-05-09T08:02:16.271457+0000","last_fullsized":"2024-05-09T08:02:16.271457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'465","last_scrub_stamp":"2024-05-09T08:02:16.271392+0000","last_deep_scrub":"23'465","last_deep_scrub_stamp":"2024-05-09T08:02:16.271392+0000","last_clean_scrub_stamp":"2024-05-09T08:02:16.271392+0000","objects_scrubbed":3,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:59:28.357891+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388678,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":512,"num_write_kb":25256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'682","reported_seq":704,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:23.685771+0000","last_change":"2024-05-09T08:02:23.685806+0000","last_active":"2024-05-09T08:02:23.685771+0000","last_peered":"2024-05-09T08:02:23.685771+0000","last_clean":"2024-05-09T08:02:23.685771+0000","last_became_active":"2024-05-09T07:55:18.558939+0000","last_became_peered":"2024-05-09T07:55:18.558939+0000","last_unstale":"2024-05-09T08:02:23.685771+0000","last_undegraded":"2024-05-09T08:02:23.685771+0000","last_fullsized":"2024-05-09T08:02:23.685771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'682","last_scrub_stamp":"2024-05-09T08:02:23.685679+0000","last_deep_scrub":"23'682","last_deep_scrub_stamp":"2024-05-09T08:02:23.685679+0000","last_clean_scrub_stamp":"2024-05-09T08:02:23.685679+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:18:59.071540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"23'250","reported_seq":280,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:16.529334+0000","last_change":"2024-05-09T08:02:16.529363+0000","last_active":"2024-05-09T08:02:16.529334+0000","last_peered":"2024-05-09T08:02:16.529334+0000","last_clean":"2024-05-09T08:02:16.529334+0000","last_became_active":"2024-05-09T07:54:36.097123+0000","last_became_peered":"2024-05-09T07:54:36.097123+0000","last_unstale":"2024-05-09T08:02:16.529334+0000","last_undegraded":"2024-05-09T08:02:16.529334+0000","last_fullsized":"2024-05-09T08:02:16.529334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'250","last_scrub_stamp":"2024-05-09T08:02:16.529261+0000","last_deep_scrub":"23'250","last_deep_scrub_stamp":"2024-05-09T08:02:16.529261+0000","last_clean_scrub_stamp":"2024-05-09T08:02:16.529261+0000","objects_scrubbed":2,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:09:05.763235+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":299,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'588","reported_seq":616,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:34.488425+0000","last_change":"2024-05-09T08:02:34.488451+0000","last_active":"2024-05-09T08:02:34.488425+0000","last_peered":"2024-05-09T08:02:34.488425+0000","last_clean":"2024-05-09T08:02:34.488425+0000","last_became_active":"2024-05-09T07:54:37.108274+0000","last_became_peered":"2024-05-09T07:54:37.108274+0000","last_unstale":"2024-05-09T08:02:34.488425+0000","last_undegraded":"2024-05-09T08:02:34.488425+0000","last_fullsized":"2024-05-09T08:02:34.488425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'588","last_scrub_stamp":"2024-05-09T08:02:34.488309+0000","last_deep_scrub":"23'588","last_deep_scrub_stamp":"2024-05-09T08:02:34.488309+0000","last_clean_scrub_stamp":"2024-05-09T08:02:34.488309+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:26:14.316116+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":738,"num_write_kb":3417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'119","reported_seq":189,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:20.473764+0000","last_change":"2024-05-09T08:02:20.473764+0000","last_active":"2024-05-09T08:02:20.473764+0000","last_peered":"2024-05-09T08:02:20.473764+0000","last_clean":"2024-05-09T08:02:20.473764+0000","last_became_active":"2024-05-09T07:54:26.680179+0000","last_became_peered":"2024-05-09T07:54:26.680179+0000","last_unstale":"2024-05-09T08:02:20.473764+0000","last_undegraded":"2024-05-09T08:02:20.473764+0000","last_fullsized":"2024-05-09T08:02:20.473764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'119","last_scrub_stamp":"2024-05-09T08:02:20.473641+0000","last_deep_scrub":"23'119","last_deep_scrub_stamp":"2024-05-09T08:02:20.473641+0000","last_clean_scrub_stamp":"2024-05-09T08:02:20.473641+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:37:57.699620+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"23'199","reported_seq":229,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:19.411278+0000","last_change":"2024-05-09T08:02:19.411338+0000","last_active":"2024-05-09T08:02:19.411278+0000","last_peered":"2024-05-09T08:02:19.411278+0000","last_clean":"2024-05-09T08:02:19.411278+0000","last_became_active":"2024-05-09T07:54:36.097343+0000","last_became_peered":"2024-05-09T07:54:36.097343+0000","last_unstale":"2024-05-09T08:02:19.411278+0000","last_undegraded":"2024-05-09T08:02:19.411278+0000","last_fullsized":"2024-05-09T08:02:19.411278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'199","last_scrub_stamp":"2024-05-09T08:02:19.411151+0000","last_deep_scrub":"23'199","last_deep_scrub_stamp":"2024-05-09T08:02:19.411151+0000","last_clean_scrub_stamp":"2024-05-09T08:02:19.411151+0000","objects_scrubbed":1,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:39.607711+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":237,"num_write_kb":12549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'566","reported_seq":594,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:26.052979+0000","last_change":"2024-05-09T08:02:26.053009+0000","last_active":"2024-05-09T08:02:26.052979+0000","last_peered":"2024-05-09T08:02:26.052979+0000","last_clean":"2024-05-09T08:02:26.052979+0000","last_became_active":"2024-05-09T07:54:37.111228+0000","last_became_peered":"2024-05-09T07:54:37.111228+0000","last_unstale":"2024-05-09T08:02:26.052979+0000","last_undegraded":"2024-05-09T08:02:26.052979+0000","last_fullsized":"2024-05-09T08:02:26.052979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'566","last_scrub_stamp":"2024-05-09T08:02:26.052880+0000","last_deep_scrub":"23'566","last_deep_scrub_stamp":"2024-05-09T08:02:26.052880+0000","last_clean_scrub_stamp":"2024-05-09T08:02:26.052880+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:36.582919+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":3530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"23'754","reported_seq":785,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:26.407031+0000","last_change":"2024-05-09T08:02:26.407031+0000","last_active":"2024-05-09T08:02:26.407031+0000","last_peered":"2024-05-09T08:02:26.407031+0000","last_clean":"2024-05-09T08:02:26.407031+0000","last_became_active":"2024-05-09T07:54:36.106923+0000","last_became_peered":"2024-05-09T07:54:36.106923+0000","last_unstale":"2024-05-09T08:02:26.407031+0000","last_undegraded":"2024-05-09T08:02:26.407031+0000","last_fullsized":"2024-05-09T08:02:26.407031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'754","last_scrub_stamp":"2024-05-09T08:02:26.406900+0000","last_deep_scrub":"23'754","last_deep_scrub_stamp":"2024-05-09T08:02:26.406900+0000","last_clean_scrub_stamp":"2024-05-09T08:02:26.406900+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:14.865521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":793,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'603","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:18.145817+0000","last_change":"2024-05-09T08:02:18.145838+0000","last_active":"2024-05-09T08:02:18.145817+0000","last_peered":"2024-05-09T08:02:18.145817+0000","last_clean":"2024-05-09T08:02:18.145817+0000","last_became_active":"2024-05-09T07:54:37.101175+0000","last_became_peered":"2024-05-09T07:54:37.101175+0000","last_unstale":"2024-05-09T08:02:18.145817+0000","last_undegraded":"2024-05-09T08:02:18.145817+0000","last_fullsized":"2024-05-09T08:02:18.145817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'603","last_scrub_stamp":"2024-05-09T08:02:18.145741+0000","last_deep_scrub":"23'603","last_deep_scrub_stamp":"2024-05-09T08:02:18.145741+0000","last_clean_scrub_stamp":"2024-05-09T08:02:18.145741+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:59:30.232240+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":3702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'938","reported_seq":1654,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:19.555253+0000","last_change":"2024-05-09T08:02:19.555278+0000","last_active":"2024-05-09T08:02:19.555253+0000","last_peered":"2024-05-09T08:02:19.555253+0000","last_clean":"2024-05-09T08:02:19.555253+0000","last_became_active":"2024-05-09T07:54:36.099482+0000","last_became_peered":"2024-05-09T07:54:36.099482+0000","last_unstale":"2024-05-09T08:02:19.555253+0000","last_undegraded":"2024-05-09T08:02:19.555253+0000","last_fullsized":"2024-05-09T08:02:19.555253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'938","last_scrub_stamp":"2024-05-09T08:02:19.555173+0000","last_deep_scrub":"23'938","last_deep_scrub_stamp":"2024-05-09T08:02:19.555173+0000","last_clean_scrub_stamp":"2024-05-09T08:02:19.555173+0000","objects_scrubbed":1,"log_size":938,"log_dups_size":0,"ondisk_log_size":938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:59:25.374776+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1512596,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":706,"num_read_kb":1945,"num_write":995,"num_write_kb":14766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'603","reported_seq":631,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:26.206168+0000","last_change":"2024-05-09T08:02:26.206197+0000","last_active":"2024-05-09T08:02:26.206168+0000","last_peered":"2024-05-09T08:02:26.206168+0000","last_clean":"2024-05-09T08:02:26.206168+0000","last_became_active":"2024-05-09T07:54:37.107247+0000","last_became_peered":"2024-05-09T07:54:37.107247+0000","last_unstale":"2024-05-09T08:02:26.206168+0000","last_undegraded":"2024-05-09T08:02:26.206168+0000","last_fullsized":"2024-05-09T08:02:26.206168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'603","last_scrub_stamp":"2024-05-09T08:02:26.206076+0000","last_deep_scrub":"23'603","last_deep_scrub_stamp":"2024-05-09T08:02:26.206076+0000","last_clean_scrub_stamp":"2024-05-09T08:02:26.206076+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:29.920353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":3437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'653","reported_seq":683,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:21.348203+0000","last_change":"2024-05-09T08:02:21.348240+0000","last_active":"2024-05-09T08:02:21.348203+0000","last_peered":"2024-05-09T08:02:21.348203+0000","last_clean":"2024-05-09T08:02:21.348203+0000","last_became_active":"2024-05-09T07:54:36.099607+0000","last_became_peered":"2024-05-09T07:54:36.099607+0000","last_unstale":"2024-05-09T08:02:21.348203+0000","last_undegraded":"2024-05-09T08:02:21.348203+0000","last_fullsized":"2024-05-09T08:02:21.348203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'653","last_scrub_stamp":"2024-05-09T08:02:21.348097+0000","last_deep_scrub":"23'653","last_deep_scrub_stamp":"2024-05-09T08:02:21.348097+0000","last_clean_scrub_stamp":"2024-05-09T08:02:21.348097+0000","objects_scrubbed":3,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:34.599401+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":708,"num_write_kb":29261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'605","reported_seq":633,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:22.764505+0000","last_change":"2024-05-09T08:02:22.764529+0000","last_active":"2024-05-09T08:02:22.764505+0000","last_peered":"2024-05-09T08:02:22.764505+0000","last_clean":"2024-05-09T08:02:22.764505+0000","last_became_active":"2024-05-09T07:54:37.108549+0000","last_became_peered":"2024-05-09T07:54:37.108549+0000","last_unstale":"2024-05-09T08:02:22.764505+0000","last_undegraded":"2024-05-09T08:02:22.764505+0000","last_fullsized":"2024-05-09T08:02:22.764505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'605","last_scrub_stamp":"2024-05-09T08:02:22.764423+0000","last_deep_scrub":"23'605","last_deep_scrub_stamp":"2024-05-09T08:02:22.764423+0000","last_clean_scrub_stamp":"2024-05-09T08:02:22.764423+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:46.002960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"23'182","reported_seq":212,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:20.145044+0000","last_change":"2024-05-09T08:02:20.145094+0000","last_active":"2024-05-09T08:02:20.145044+0000","last_peered":"2024-05-09T08:02:20.145044+0000","last_clean":"2024-05-09T08:02:20.145044+0000","last_became_active":"2024-05-09T07:54:36.103660+0000","last_became_peered":"2024-05-09T07:54:36.103660+0000","last_unstale":"2024-05-09T08:02:20.145044+0000","last_undegraded":"2024-05-09T08:02:20.145044+0000","last_fullsized":"2024-05-09T08:02:20.145044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'182","last_scrub_stamp":"2024-05-09T08:02:20.144901+0000","last_deep_scrub":"23'182","last_deep_scrub_stamp":"2024-05-09T08:02:20.144901+0000","last_clean_scrub_stamp":"2024-05-09T08:02:20.144901+0000","objects_scrubbed":1,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:06:29.889059+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":263,"num_write_kb":8685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'644","reported_seq":672,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:28.383642+0000","last_change":"2024-05-09T08:02:28.383709+0000","last_active":"2024-05-09T08:02:28.383642+0000","last_peered":"2024-05-09T08:02:28.383642+0000","last_clean":"2024-05-09T08:02:28.383642+0000","last_became_active":"2024-05-09T07:54:37.103277+0000","last_became_peered":"2024-05-09T07:54:37.103277+0000","last_unstale":"2024-05-09T08:02:28.383642+0000","last_undegraded":"2024-05-09T08:02:28.383642+0000","last_fullsized":"2024-05-09T08:02:28.383642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'644","last_scrub_stamp":"2024-05-09T08:02:28.383412+0000","last_deep_scrub":"23'644","last_deep_scrub_stamp":"2024-05-09T08:02:28.383412+0000","last_clean_scrub_stamp":"2024-05-09T08:02:28.383412+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:47:03.584701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"23'489","reported_seq":519,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:23.419195+0000","last_change":"2024-05-09T08:02:23.419225+0000","last_active":"2024-05-09T08:02:23.419195+0000","last_peered":"2024-05-09T08:02:23.419195+0000","last_clean":"2024-05-09T08:02:23.419195+0000","last_became_active":"2024-05-09T07:54:36.105868+0000","last_became_peered":"2024-05-09T07:54:36.105868+0000","last_unstale":"2024-05-09T08:02:23.419195+0000","last_undegraded":"2024-05-09T08:02:23.419195+0000","last_fullsized":"2024-05-09T08:02:23.419195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'489","last_scrub_stamp":"2024-05-09T08:02:23.419107+0000","last_deep_scrub":"23'489","last_deep_scrub_stamp":"2024-05-09T08:02:23.419107+0000","last_clean_scrub_stamp":"2024-05-09T08:02:23.419107+0000","objects_scrubbed":1,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:21:37.582587+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":548,"num_write_kb":21106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'589","reported_seq":617,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:24.262839+0000","last_change":"2024-05-09T08:02:24.262876+0000","last_active":"2024-05-09T08:02:24.262839+0000","last_peered":"2024-05-09T08:02:24.262839+0000","last_clean":"2024-05-09T08:02:24.262839+0000","last_became_active":"2024-05-09T07:54:37.105693+0000","last_became_peered":"2024-05-09T07:54:37.105693+0000","last_unstale":"2024-05-09T08:02:24.262839+0000","last_undegraded":"2024-05-09T08:02:24.262839+0000","last_fullsized":"2024-05-09T08:02:24.262839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'589","last_scrub_stamp":"2024-05-09T08:02:24.262706+0000","last_deep_scrub":"23'589","last_deep_scrub_stamp":"2024-05-09T08:02:24.262706+0000","last_clean_scrub_stamp":"2024-05-09T08:02:24.262706+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:21:37.514010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":713,"num_write_kb":3737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'477","reported_seq":507,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:17.232270+0000","last_change":"2024-05-09T08:02:17.232298+0000","last_active":"2024-05-09T08:02:17.232270+0000","last_peered":"2024-05-09T08:02:17.232270+0000","last_clean":"2024-05-09T08:02:17.232270+0000","last_became_active":"2024-05-09T07:54:36.100713+0000","last_became_peered":"2024-05-09T07:54:36.100713+0000","last_unstale":"2024-05-09T08:02:17.232270+0000","last_undegraded":"2024-05-09T08:02:17.232270+0000","last_fullsized":"2024-05-09T08:02:17.232270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'477","last_scrub_stamp":"2024-05-09T08:02:17.232192+0000","last_deep_scrub":"23'477","last_deep_scrub_stamp":"2024-05-09T08:02:17.232192+0000","last_clean_scrub_stamp":"2024-05-09T08:02:17.232192+0000","objects_scrubbed":3,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:18:52.618053+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":1199,"num_write_kb":9658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'541","reported_seq":569,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:20.076029+0000","last_change":"2024-05-09T08:02:20.076053+0000","last_active":"2024-05-09T08:02:20.076029+0000","last_peered":"2024-05-09T08:02:20.076029+0000","last_clean":"2024-05-09T08:02:20.076029+0000","last_became_active":"2024-05-09T07:54:37.099919+0000","last_became_peered":"2024-05-09T07:54:37.099919+0000","last_unstale":"2024-05-09T08:02:20.076029+0000","last_undegraded":"2024-05-09T08:02:20.076029+0000","last_fullsized":"2024-05-09T08:02:20.076029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'541","last_scrub_stamp":"2024-05-09T08:02:20.075934+0000","last_deep_scrub":"23'541","last_deep_scrub_stamp":"2024-05-09T08:02:20.075934+0000","last_clean_scrub_stamp":"2024-05-09T08:02:20.075934+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:55:58.856339+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":3246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'252","reported_seq":282,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:22.761163+0000","last_change":"2024-05-09T08:02:22.761220+0000","last_active":"2024-05-09T08:02:22.761163+0000","last_peered":"2024-05-09T08:02:22.761163+0000","last_clean":"2024-05-09T08:02:22.761163+0000","last_became_active":"2024-05-09T07:54:36.105535+0000","last_became_peered":"2024-05-09T07:54:36.105535+0000","last_unstale":"2024-05-09T08:02:22.761163+0000","last_undegraded":"2024-05-09T08:02:22.761163+0000","last_fullsized":"2024-05-09T08:02:22.761163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'252","last_scrub_stamp":"2024-05-09T08:02:22.761065+0000","last_deep_scrub":"23'252","last_deep_scrub_stamp":"2024-05-09T08:02:22.761065+0000","last_clean_scrub_stamp":"2024-05-09T08:02:22.761065+0000","objects_scrubbed":2,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:35.142911+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":329,"num_write_kb":8747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'732","reported_seq":760,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:21.204365+0000","last_change":"2024-05-09T08:02:21.204391+0000","last_active":"2024-05-09T08:02:21.204365+0000","last_peered":"2024-05-09T08:02:21.204365+0000","last_clean":"2024-05-09T08:02:21.204365+0000","last_became_active":"2024-05-09T07:54:37.107506+0000","last_became_peered":"2024-05-09T07:54:37.107506+0000","last_unstale":"2024-05-09T08:02:21.204365+0000","last_undegraded":"2024-05-09T08:02:21.204365+0000","last_fullsized":"2024-05-09T08:02:21.204365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'732","last_scrub_stamp":"2024-05-09T08:02:21.204246+0000","last_deep_scrub":"23'732","last_deep_scrub_stamp":"2024-05-09T08:02:21.204246+0000","last_clean_scrub_stamp":"2024-05-09T08:02:21.204246+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:17:33.586092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":4062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"23'190","reported_seq":220,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:24.390254+0000","last_change":"2024-05-09T08:02:24.390281+0000","last_active":"2024-05-09T08:02:24.390254+0000","last_peered":"2024-05-09T08:02:24.390254+0000","last_clean":"2024-05-09T08:02:24.390254+0000","last_became_active":"2024-05-09T07:54:36.104738+0000","last_became_peered":"2024-05-09T07:54:36.104738+0000","last_unstale":"2024-05-09T08:02:24.390254+0000","last_undegraded":"2024-05-09T08:02:24.390254+0000","last_fullsized":"2024-05-09T08:02:24.390254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'190","last_scrub_stamp":"2024-05-09T08:02:24.390170+0000","last_deep_scrub":"23'190","last_deep_scrub_stamp":"2024-05-09T08:02:24.390170+0000","last_clean_scrub_stamp":"2024-05-09T08:02:24.390170+0000","objects_scrubbed":1,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:28.104447+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":230,"num_write_kb":8511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'679","reported_seq":707,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:21.729484+0000","last_change":"2024-05-09T08:02:21.729530+0000","last_active":"2024-05-09T08:02:21.729484+0000","last_peered":"2024-05-09T08:02:21.729484+0000","last_clean":"2024-05-09T08:02:21.729484+0000","last_became_active":"2024-05-09T07:54:37.104625+0000","last_became_peered":"2024-05-09T07:54:37.104625+0000","last_unstale":"2024-05-09T08:02:21.729484+0000","last_undegraded":"2024-05-09T08:02:21.729484+0000","last_fullsized":"2024-05-09T08:02:21.729484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'679","last_scrub_stamp":"2024-05-09T08:02:21.729381+0000","last_deep_scrub":"23'679","last_deep_scrub_stamp":"2024-05-09T08:02:21.729381+0000","last_clean_scrub_stamp":"2024-05-09T08:02:21.729381+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:11:18.095960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":3995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"23'231","reported_seq":261,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:21.183437+0000","last_change":"2024-05-09T08:02:21.183484+0000","last_active":"2024-05-09T08:02:21.183437+0000","last_peered":"2024-05-09T08:02:21.183437+0000","last_clean":"2024-05-09T08:02:21.183437+0000","last_became_active":"2024-05-09T07:54:36.105389+0000","last_became_peered":"2024-05-09T07:54:36.105389+0000","last_unstale":"2024-05-09T08:02:21.183437+0000","last_undegraded":"2024-05-09T08:02:21.183437+0000","last_fullsized":"2024-05-09T08:02:21.183437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'231","last_scrub_stamp":"2024-05-09T08:02:21.183335+0000","last_deep_scrub":"23'231","last_deep_scrub_stamp":"2024-05-09T08:02:21.183335+0000","last_clean_scrub_stamp":"2024-05-09T08:02:21.183335+0000","objects_scrubbed":1,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:16:41.379895+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":261,"num_write_kb":12547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'635","reported_seq":663,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:22.059694+0000","last_change":"2024-05-09T08:02:22.059719+0000","last_active":"2024-05-09T08:02:22.059694+0000","last_peered":"2024-05-09T08:02:22.059694+0000","last_clean":"2024-05-09T08:02:22.059694+0000","last_became_active":"2024-05-09T07:54:37.101456+0000","last_became_peered":"2024-05-09T07:54:37.101456+0000","last_unstale":"2024-05-09T08:02:22.059694+0000","last_undegraded":"2024-05-09T08:02:22.059694+0000","last_fullsized":"2024-05-09T08:02:22.059694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'635","last_scrub_stamp":"2024-05-09T08:02:22.059598+0000","last_deep_scrub":"23'635","last_deep_scrub_stamp":"2024-05-09T08:02:22.059598+0000","last_clean_scrub_stamp":"2024-05-09T08:02:22.059598+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:51.485542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":769,"num_write_kb":3488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"23'496","reported_seq":526,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:19.183860+0000","last_change":"2024-05-09T08:02:19.183911+0000","last_active":"2024-05-09T08:02:19.183860+0000","last_peered":"2024-05-09T08:02:19.183860+0000","last_clean":"2024-05-09T08:02:19.183860+0000","last_became_active":"2024-05-09T07:54:36.102341+0000","last_became_peered":"2024-05-09T07:54:36.102341+0000","last_unstale":"2024-05-09T08:02:19.183860+0000","last_undegraded":"2024-05-09T08:02:19.183860+0000","last_fullsized":"2024-05-09T08:02:19.183860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'496","last_scrub_stamp":"2024-05-09T08:02:19.183771+0000","last_deep_scrub":"23'496","last_deep_scrub_stamp":"2024-05-09T08:02:19.183771+0000","last_clean_scrub_stamp":"2024-05-09T08:02:19.183771+0000","objects_scrubbed":3,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:30:47.943274+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":567,"num_write_kb":25391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'646","reported_seq":668,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:29.231596+0000","last_change":"2024-05-09T08:02:29.231619+0000","last_active":"2024-05-09T08:02:29.231596+0000","last_peered":"2024-05-09T08:02:29.231596+0000","last_clean":"2024-05-09T08:02:29.231596+0000","last_became_active":"2024-05-09T07:55:18.902275+0000","last_became_peered":"2024-05-09T07:55:18.902275+0000","last_unstale":"2024-05-09T08:02:29.231596+0000","last_undegraded":"2024-05-09T08:02:29.231596+0000","last_fullsized":"2024-05-09T08:02:29.231596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'646","last_scrub_stamp":"2024-05-09T08:02:29.231519+0000","last_deep_scrub":"23'646","last_deep_scrub_stamp":"2024-05-09T08:02:29.231519+0000","last_clean_scrub_stamp":"2024-05-09T08:02:29.231519+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:29.046947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":3818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"23'890","reported_seq":920,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:21.474230+0000","last_change":"2024-05-09T08:02:21.474295+0000","last_active":"2024-05-09T08:02:21.474230+0000","last_peered":"2024-05-09T08:02:21.474230+0000","last_clean":"2024-05-09T08:02:21.474230+0000","last_became_active":"2024-05-09T07:54:36.104014+0000","last_became_peered":"2024-05-09T07:54:36.104014+0000","last_unstale":"2024-05-09T08:02:21.474230+0000","last_undegraded":"2024-05-09T08:02:21.474230+0000","last_fullsized":"2024-05-09T08:02:21.474230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'890","last_scrub_stamp":"2024-05-09T08:02:21.474130+0000","last_deep_scrub":"23'890","last_deep_scrub_stamp":"2024-05-09T08:02:21.474130+0000","last_clean_scrub_stamp":"2024-05-09T08:02:21.474130+0000","objects_scrubbed":3,"log_size":890,"log_dups_size":0,"ondisk_log_size":890,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:52.712940+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":934,"num_write_kb":29264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'642","reported_seq":670,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:24.736964+0000","last_change":"2024-05-09T08:02:24.736990+0000","last_active":"2024-05-09T08:02:24.736964+0000","last_peered":"2024-05-09T08:02:24.736964+0000","last_clean":"2024-05-09T08:02:24.736964+0000","last_became_active":"2024-05-09T07:54:37.110618+0000","last_became_peered":"2024-05-09T07:54:37.110618+0000","last_unstale":"2024-05-09T08:02:24.736964+0000","last_undegraded":"2024-05-09T08:02:24.736964+0000","last_fullsized":"2024-05-09T08:02:24.736964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'642","last_scrub_stamp":"2024-05-09T08:02:24.736820+0000","last_deep_scrub":"23'642","last_deep_scrub_stamp":"2024-05-09T08:02:24.736820+0000","last_clean_scrub_stamp":"2024-05-09T08:02:24.736820+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:21.208490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":3781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'597","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:22.643679+0000","last_change":"2024-05-09T08:02:22.643704+0000","last_active":"2024-05-09T08:02:22.643679+0000","last_peered":"2024-05-09T08:02:22.643679+0000","last_clean":"2024-05-09T08:02:22.643679+0000","last_became_active":"2024-05-09T07:55:18.558037+0000","last_became_peered":"2024-05-09T07:55:18.558037+0000","last_unstale":"2024-05-09T08:02:22.643679+0000","last_undegraded":"2024-05-09T08:02:22.643679+0000","last_fullsized":"2024-05-09T08:02:22.643679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'597","last_scrub_stamp":"2024-05-09T08:02:22.643584+0000","last_deep_scrub":"23'597","last_deep_scrub_stamp":"2024-05-09T08:02:22.643584+0000","last_clean_scrub_stamp":"2024-05-09T08:02:22.643584+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T18:59:34.730083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":3332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"23'191","reported_seq":221,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:22.443666+0000","last_change":"2024-05-09T08:02:22.443692+0000","last_active":"2024-05-09T08:02:22.443666+0000","last_peered":"2024-05-09T08:02:22.443666+0000","last_clean":"2024-05-09T08:02:22.443666+0000","last_became_active":"2024-05-09T07:54:36.105427+0000","last_became_peered":"2024-05-09T07:54:36.105427+0000","last_unstale":"2024-05-09T08:02:22.443666+0000","last_undegraded":"2024-05-09T08:02:22.443666+0000","last_fullsized":"2024-05-09T08:02:22.443666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'191","last_scrub_stamp":"2024-05-09T08:02:22.443566+0000","last_deep_scrub":"23'191","last_deep_scrub_stamp":"2024-05-09T08:02:22.443566+0000","last_clean_scrub_stamp":"2024-05-09T08:02:22.443566+0000","objects_scrubbed":1,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:28:38.758063+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":262,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'590","reported_seq":618,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:23.350836+0000","last_change":"2024-05-09T08:02:23.350861+0000","last_active":"2024-05-09T08:02:23.350836+0000","last_peered":"2024-05-09T08:02:23.350836+0000","last_clean":"2024-05-09T08:02:23.350836+0000","last_became_active":"2024-05-09T07:54:37.091769+0000","last_became_peered":"2024-05-09T07:54:37.091769+0000","last_unstale":"2024-05-09T08:02:23.350836+0000","last_undegraded":"2024-05-09T08:02:23.350836+0000","last_fullsized":"2024-05-09T08:02:23.350836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'590","last_scrub_stamp":"2024-05-09T08:02:23.350749+0000","last_deep_scrub":"23'590","last_deep_scrub_stamp":"2024-05-09T08:02:23.350749+0000","last_clean_scrub_stamp":"2024-05-09T08:02:23.350749+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T19:34:38.538394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":726,"num_write_kb":3356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'1117","reported_seq":1147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:25.430765+0000","last_change":"2024-05-09T08:02:25.430796+0000","last_active":"2024-05-09T08:02:25.430765+0000","last_peered":"2024-05-09T08:02:25.430765+0000","last_clean":"2024-05-09T08:02:25.430765+0000","last_became_active":"2024-05-09T07:54:36.106268+0000","last_became_peered":"2024-05-09T07:54:36.106268+0000","last_unstale":"2024-05-09T08:02:25.430765+0000","last_undegraded":"2024-05-09T08:02:25.430765+0000","last_fullsized":"2024-05-09T08:02:25.430765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1117","last_scrub_stamp":"2024-05-09T08:02:25.430678+0000","last_deep_scrub":"23'1117","last_deep_scrub_stamp":"2024-05-09T08:02:25.430678+0000","last_clean_scrub_stamp":"2024-05-09T08:02:25.430678+0000","objects_scrubbed":2,"log_size":1117,"log_dups_size":0,"ondisk_log_size":1117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:11:50.650762+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":1161,"num_write_kb":29324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'532","reported_seq":560,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:23.215807+0000","last_change":"2024-05-09T08:02:23.215835+0000","last_active":"2024-05-09T08:02:23.215807+0000","last_peered":"2024-05-09T08:02:23.215807+0000","last_clean":"2024-05-09T08:02:23.215807+0000","last_became_active":"2024-05-09T07:54:37.107553+0000","last_became_peered":"2024-05-09T07:54:37.107553+0000","last_unstale":"2024-05-09T08:02:23.215807+0000","last_undegraded":"2024-05-09T08:02:23.215807+0000","last_fullsized":"2024-05-09T08:02:23.215807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'532","last_scrub_stamp":"2024-05-09T08:02:23.215676+0000","last_deep_scrub":"23'532","last_deep_scrub_stamp":"2024-05-09T08:02:23.215676+0000","last_clean_scrub_stamp":"2024-05-09T08:02:23.215676+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:56:01.996082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":3333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"23'709","reported_seq":740,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:17.096891+0000","last_change":"2024-05-09T08:02:17.096891+0000","last_active":"2024-05-09T08:02:17.096891+0000","last_peered":"2024-05-09T08:02:17.096891+0000","last_clean":"2024-05-09T08:02:17.096891+0000","last_became_active":"2024-05-09T07:54:36.102204+0000","last_became_peered":"2024-05-09T07:54:36.102204+0000","last_unstale":"2024-05-09T08:02:17.096891+0000","last_undegraded":"2024-05-09T08:02:17.096891+0000","last_fullsized":"2024-05-09T08:02:17.096891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'709","last_scrub_stamp":"2024-05-09T08:02:17.096778+0000","last_deep_scrub":"23'709","last_deep_scrub_stamp":"2024-05-09T08:02:17.096778+0000","last_clean_scrub_stamp":"2024-05-09T08:02:17.096778+0000","objects_scrubbed":1,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:04:20.527801+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":745,"num_write_kb":29116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'614","reported_seq":643,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:24.133959+0000","last_change":"2024-05-09T08:02:24.133959+0000","last_active":"2024-05-09T08:02:24.133959+0000","last_peered":"2024-05-09T08:02:24.133959+0000","last_clean":"2024-05-09T08:02:24.133959+0000","last_became_active":"2024-05-09T07:54:37.104205+0000","last_became_peered":"2024-05-09T07:54:37.104205+0000","last_unstale":"2024-05-09T08:02:24.133959+0000","last_undegraded":"2024-05-09T08:02:24.133959+0000","last_fullsized":"2024-05-09T08:02:24.133959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'614","last_scrub_stamp":"2024-05-09T08:02:24.133844+0000","last_deep_scrub":"23'614","last_deep_scrub_stamp":"2024-05-09T08:02:24.133844+0000","last_clean_scrub_stamp":"2024-05-09T08:02:24.133844+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:42:36.607176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":3720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'493","reported_seq":523,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-09T08:02:17.188143+0000","last_change":"2024-05-09T08:02:17.188167+0000","last_active":"2024-05-09T08:02:17.188143+0000","last_peered":"2024-05-09T08:02:17.188143+0000","last_clean":"2024-05-09T08:02:17.188143+0000","last_became_active":"2024-05-09T07:54:36.101469+0000","last_became_peered":"2024-05-09T07:54:36.101469+0000","last_unstale":"2024-05-09T08:02:17.188143+0000","last_undegraded":"2024-05-09T08:02:17.188143+0000","last_fullsized":"2024-05-09T08:02:17.188143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'493","last_scrub_stamp":"2024-05-09T08:02:17.188080+0000","last_deep_scrub":"23'493","last_deep_scrub_stamp":"2024-05-09T08:02:17.188080+0000","last_clean_scrub_stamp":"2024-05-09T08:02:17.188080+0000","objects_scrubbed":2,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:24:40.426617+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":559,"num_write_kb":8798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48848,"num_write_kb":235793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39700,"ondisk_log_size":39700,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":150307698,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":1306,"num_read_kb":1945,"num_write":17417,"num_write_kb":525877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5987,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":300679168,"data_stored":300615396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15106,"ondisk_log_size":15106,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542246,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":102712,"kb_used_data":53488,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94269128,"statfs":{"total":96636764160,"available":96531587072,"internally_reserved":0,"allocated":54771712,"data_stored":54613426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542246,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78848,"kb_used_data":21304,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94292992,"statfs":{"total":96636764160,"available":96556023808,"internally_reserved":0,"allocated":21815296,"data_stored":21649840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100920,"kb_used_data":29488,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270920,"statfs":{"total":96636764160,"available":96533422080,"internally_reserved":0,"allocated":30195712,"data_stored":30038392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122772,"kb_used_data":47244,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94249068,"statfs":{"total":96636764160,"available":96511045632,"internally_reserved":0,"allocated":48377856,"data_stored":48218322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77330886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108752,"kb_used_data":59528,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94263088,"statfs":{"total":96636764160,"available":96525402112,"internally_reserved":0,"allocated":60956672,"data_stored":60800652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116668,"kb_used_data":45300,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94255172,"statfs":{"total":96636764160,"available":96517296128,"internally_reserved":0,"allocated":46387200,"data_stored":46224784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105984,"kb_used_data":26296,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94265856,"statfs":{"total":96636764160,"available":96528236544,"internally_reserved":0,"allocated":26927104,"data_stored":26766406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":81590727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71544,"kb_used_data":14000,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300296,"statfs":{"total":96636764160,"available":96563503104,"internally_reserved":0,"allocated":14336000,"data_stored":14182822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20983808,"data_stored":20972158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":54534144,"data_stored":54526112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14098432,"data_stored":14095508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26689536,"data_stored":26679092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":60719104,"data_stored":60713338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48140288,"data_stored":48131008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T08:02:39.284 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-09T08:02:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.402+0000 7f3abafc1640 1 Processor -- start 2024-05-09T08:02:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.402+0000 7f3abafc1640 1 -- start start 2024-05-09T08:02:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.402+0000 7f3abafc1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ab40b39d0 0x7f3ab40add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.402+0000 7f3abafc1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.402+0000 7f3abafc1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ab40b15a0 con 0x7f3ab4148180 2024-05-09T08:02:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.402+0000 7f3abafc1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab40ae720 con 0x7f3ab40b39d0 2024-05-09T08:02:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.402+0000 7f3abafc1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab40b3db0 con 0x7f3ab40ae2c0 2024-05-09T08:02:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.420 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab8d5d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ab40b39d0 0x7f3ab40add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab955e640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3ab4148180 0x7f3ab4146bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.87:36696/0 (socket says 172.21.15.87:36696) 2024-05-09T08:02:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab8d5d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ab40b39d0 0x7f3ab40add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.87:55928/0 (socket says 172.21.15.87:55928) 2024-05-09T08:02:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab955e640 1 -- 172.21.15.87:0/1030938978 learned_addr learned my addr 172.21.15.87:0/1030938978 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:58852/0 (socket says 172.21.15.87:58852) 2024-05-09T08:02:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab8d5d640 1 -- 172.21.15.87:0/1030938978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 msgr2=0x7f3ab4147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab8d5d640 1 --2- 172.21.15.87:0/1030938978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab8d5d640 1 -- 172.21.15.87:0/1030938978 >> v1:172.21.15.110:6789/0 conn(0x7f3ab4148180 legacy=0x7f3ab4146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab8d5d640 1 -- 172.21.15.87:0/1030938978 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab40af940 con 0x7f3ab40b39d0 2024-05-09T08:02:39.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.403+0000 7f3ab3fff640 1 --2- 172.21.15.87:0/1030938978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:02:39.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.404+0000 7f3ab8d5d640 1 --2- 172.21.15.87:0/1030938978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab40b39d0 0x7f3ab40add80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0097a0 tx=0x7f3aac02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2aa611b7520568 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:39.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.404+0000 7f3ab37fe640 1 -- 172.21.15.87:0/1030938978 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac037070 con 0x7f3ab40b39d0 2024-05-09T08:02:39.425 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.404+0000 7f3ab37fe640 1 -- 172.21.15.87:0/1030938978 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aac02ae50 con 0x7f3ab40b39d0 2024-05-09T08:02:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.404+0000 7f3ab37fe640 1 -- 172.21.15.87:0/1030938978 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac032660 con 0x7f3ab40b39d0 2024-05-09T08:02:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.404+0000 7f3abafc1640 1 -- 172.21.15.87:0/1030938978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab40b39d0 msgr2=0x7f3ab40add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.404+0000 7f3abafc1640 1 --2- 172.21.15.87:0/1030938978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab40b39d0 0x7f3ab40add80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0097a0 tx=0x7f3aac02a100 comp rx=0 tx=0).stop 2024-05-09T08:02:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.405+0000 7f3abafc1640 1 -- 172.21.15.87:0/1030938978 shutdown_connections 2024-05-09T08:02:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.405+0000 7f3abafc1640 1 --2- 172.21.15.87:0/1030938978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.405+0000 7f3abafc1640 1 --2- 172.21.15.87:0/1030938978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab40b39d0 0x7f3ab40add80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.405+0000 7f3abafc1640 1 -- 172.21.15.87:0/1030938978 >> 172.21.15.87:0/1030938978 conn(0x7f3ab40b5860 msgr2=0x7f3ab40b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.405+0000 7f3abafc1640 1 -- 172.21.15.87:0/1030938978 shutdown_connections 2024-05-09T08:02:39.426 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.405+0000 7f3abafc1640 1 -- 172.21.15.87:0/1030938978 wait complete. 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3abafc1640 1 Processor -- start 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3abafc1640 1 -- start start 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3abafc1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4141570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3abafc1640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab40b39d0 0x7f3ab4142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3abafc1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab4148180 0x7f3ab41406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3abafc1640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab406d9b0 con 0x7f3ab40b39d0 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3abafc1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab406d830 con 0x7f3ab4148180 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3abafc1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab4148610 con 0x7f3ab40ae2c0 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3ab3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab40b39d0 0x7f3ab4142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3ab3fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab40b39d0 0x7f3ab4142ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33940/0 (socket says 172.21.15.87:33940) 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3ab3fff640 1 -- 172.21.15.87:0/2413551787 learned_addr learned my addr 172.21.15.87:0/2413551787 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3ab955e640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab4148180 0x7f3ab41406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.427 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.406+0000 7f3ab8d5d640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab3fff640 1 -- 172.21.15.87:0/2413551787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 msgr2=0x7f3ab4141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab3fff640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab3fff640 1 -- 172.21.15.87:0/2413551787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab4148180 msgr2=0x7f3ab41406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab3fff640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab4148180 0x7f3ab41406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab3fff640 1 -- 172.21.15.87:0/2413551787 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab4143300 con 0x7f3ab40b39d0 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab955e640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab4148180 0x7f3ab41406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab3fff640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab40b39d0 0x7f3ab4142ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400efc0 tx=0x7f3aa400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab17fa640 1 -- 172.21.15.87:0/2413551787 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4018020 con 0x7f3ab40b39d0 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab17fa640 1 -- 172.21.15.87:0/2413551787 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4014680 con 0x7f3ab40b39d0 2024-05-09T08:02:39.428 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab4141b50 con 0x7f3ab40b39d0 2024-05-09T08:02:39.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3ab17fa640 1 -- 172.21.15.87:0/2413551787 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4014a50 con 0x7f3ab40b39d0 2024-05-09T08:02:39.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.407+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab413e010 con 0x7f3ab40b39d0 2024-05-09T08:02:39.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.408+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab40691f0 con 0x7f3ab40b39d0 2024-05-09T08:02:39.429 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.409+0000 7f3ab17fa640 1 -- 172.21.15.87:0/2413551787 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3aa4005d10 con 0x7f3ab40b39d0 2024-05-09T08:02:39.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.409+0000 7f3ab17fa640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3a9406be60 0x7f3a9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.409+0000 7f3ab8d5d640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3a9406be60 0x7f3a9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.409+0000 7f3ab17fa640 1 -- 172.21.15.87:0/2413551787 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f3aa408bba0 con 0x7f3ab40b39d0 2024-05-09T08:02:39.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.410+0000 7f3ab8d5d640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3a9406be60 0x7f3a9406e320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3aac034000 tx=0x7f3aac02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:39.430 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.414+0000 7f3ab17fa640 1 -- 172.21.15.87:0/2413551787 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f3aa4022030 con 0x7f3ab40b39d0 2024-05-09T08:02:39.610 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.594+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3ab4141ee0 con 0x7f3ab40b39d0 2024-05-09T08:02:39.618 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.601+0000 7f3ab17fa640 1 -- 172.21.15.87:0/2413551787 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f3aa4010040 con 0x7f3ab40b39d0 2024-05-09T08:02:39.619 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.602+0000 7f3ab17fa640 1 -- 172.21.15.87:0/2413551787 <== mon.0 v2:172.21.15.87:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3aa4059f00 con 0x7f3ab40b39d0 2024-05-09T08:02:39.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3a9406be60 msgr2=0x7f3a9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3a9406be60 0x7f3a9406e320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3aac034000 tx=0x7f3aac02e000 comp rx=0 tx=0).stop 2024-05-09T08:02:39.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab40b39d0 msgr2=0x7f3ab4142ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.621 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab40b39d0 0x7f3ab4142ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400efc0 tx=0x7f3aa400c490 comp rx=0 tx=0).stop 2024-05-09T08:02:39.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 shutdown_connections 2024-05-09T08:02:39.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f3a9406be60 0x7f3a9406e320 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ab4148180 0x7f3ab41406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ab40b39d0 0x7f3ab4142ca0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 --2- 172.21.15.87:0/2413551787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ab40ae2c0 0x7f3ab4141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.622 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 >> 172.21.15.87:0/2413551787 conn(0x7f3ab40b5860 msgr2=0x7f3ab40b7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:39.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 shutdown_connections 2024-05-09T08:02:39.623 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.604+0000 7f3abafc1640 1 -- 172.21.15.87:0/2413551787 wait complete. 2024-05-09T08:02:39.633 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T08:02:39.633 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T08:02:39.734 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.718+0000 7f55cc6d2640 1 Processor -- start 2024-05-09T08:02:39.735 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.718+0000 7f55cc6d2640 1 -- start start 2024-05-09T08:02:39.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.718+0000 7f55cc6d2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55c40b5e60 0x7f55c40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.718+0000 7f55cc6d2640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55c40b5330 0x7f55c40b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.718+0000 7f55cc6d2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55c40b6240 con 0x7f55c40b2770 2024-05-09T08:02:39.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.718+0000 7f55cc6d2640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f55c40b0470 con 0x7f55c40b5330 2024-05-09T08:02:39.737 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.718+0000 7f55cc6d2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f55c40b2be0 con 0x7f55c40b5e60 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.719+0000 7f55c9c6d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55c40b5330 0x7f55c40b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.719+0000 7f55c9c6d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f55c40b5330 0x7f55c40b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33954/0 (socket says 172.21.15.87:33954) 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.719+0000 7f55c9c6d640 1 -- 172.21.15.87:0/1876071594 learned_addr learned my addr 172.21.15.87:0/1876071594 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.719+0000 7f55ca46e640 1 --2- 172.21.15.87:0/1876071594 >> v2:172.21.15.110:3300/0 conn(0x7f55c40b5e60 0x7f55c40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.719+0000 7f55c9c6d640 1 -- 172.21.15.87:0/1876071594 >> v2:172.21.15.110:3300/0 conn(0x7f55c40b5e60 msgr2=0x7f55c40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.719+0000 7f55c9c6d640 1 --2- 172.21.15.87:0/1876071594 >> v2:172.21.15.110:3300/0 conn(0x7f55c40b5e60 0x7f55c40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.719+0000 7f55c9c6d640 1 -- 172.21.15.87:0/1876071594 >> v1:172.21.15.110:6789/0 conn(0x7f55c40b2770 legacy=0x7f55c4146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.719+0000 7f55c9c6d640 1 -- 172.21.15.87:0/1876071594 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c40b1860 con 0x7f55c40b5330 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55c9c6d640 1 --2- 172.21.15.87:0/1876071594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 0x7f55c40b2230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55c406dc50 tx=0x7f55b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2a52802c74adb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55c946c640 1 -- 172.21.15.87:0/1876071594 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b4037070 con 0x7f55c40b5330 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55c946c640 1 -- 172.21.15.87:0/1876071594 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f55b4032440 con 0x7f55c40b5330 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55c946c640 1 -- 172.21.15.87:0/1876071594 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b4032830 con 0x7f55c40b5330 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55cc6d2640 1 -- 172.21.15.87:0/1876071594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 msgr2=0x7f55c40b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55cc6d2640 1 --2- 172.21.15.87:0/1876071594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 0x7f55c40b2230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55c406dc50 tx=0x7f55b402a1e0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.738 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55cc6d2640 1 -- 172.21.15.87:0/1876071594 shutdown_connections 2024-05-09T08:02:39.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55cc6d2640 1 --2- 172.21.15.87:0/1876071594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 0x7f55c40b2230 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55cc6d2640 1 --2- 172.21.15.87:0/1876071594 >> v2:172.21.15.110:3300/0 conn(0x7f55c40b5e60 0x7f55c40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.720+0000 7f55cc6d2640 1 -- 172.21.15.87:0/1876071594 >> 172.21.15.87:0/1876071594 conn(0x7f55c406c6a0 msgr2=0x7f55c406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:39.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.721+0000 7f55cc6d2640 1 -- 172.21.15.87:0/1876071594 shutdown_connections 2024-05-09T08:02:39.739 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.721+0000 7f55cc6d2640 1 -- 172.21.15.87:0/1876071594 wait complete. 2024-05-09T08:02:39.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.721+0000 7f55cc6d2640 1 Processor -- start 2024-05-09T08:02:39.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55cc6d2640 1 -- start start 2024-05-09T08:02:39.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55cc6d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c40b2770 0x7f55c41defc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55cc6d2640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 0x7f55c4148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55cc6d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c40b5e60 0x7f55c41db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55cc6d2640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f55c40af960 con 0x7f55c40b5330 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55cc6d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f55c40b1580 con 0x7f55c40b2770 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55cc6d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f55c40afae0 con 0x7f55c40b5e60 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55c9c6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 0x7f55c4148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55c9c6d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 0x7f55c4148c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33968/0 (socket says 172.21.15.87:33968) 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55c9c6d640 1 -- 172.21.15.87:0/3723970565 learned_addr learned my addr 172.21.15.87:0/3723970565 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55ca46e640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c40b2770 0x7f55c41defc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55cac6f640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c40b5e60 0x7f55c41db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55c9c6d640 1 -- 172.21.15.87:0/3723970565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c40b5e60 msgr2=0x7f55c41db8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55c9c6d640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c40b5e60 0x7f55c41db8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.742 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55c9c6d640 1 -- 172.21.15.87:0/3723970565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c40b2770 msgr2=0x7f55c41defc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55c9c6d640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c40b2770 0x7f55c41defc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55c9c6d640 1 -- 172.21.15.87:0/3723970565 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c414b070 con 0x7f55c40b5330 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.722+0000 7f55cac6f640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c40b5e60 0x7f55c41db8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.723+0000 7f55c9c6d640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 0x7f55c4148c00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f55b402a220 tx=0x7f55b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.723+0000 7f55baffd640 1 -- 172.21.15.87:0/3723970565 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b4037040 con 0x7f55c40b5330 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.723+0000 7f55baffd640 1 -- 172.21.15.87:0/3723970565 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f55b4042070 con 0x7f55c40b5330 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.723+0000 7f55baffd640 1 -- 172.21.15.87:0/3723970565 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b4030920 con 0x7f55c40b5330 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.723+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c41de7c0 con 0x7f55c40b5330 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.723+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c409bce0 con 0x7f55c40b5330 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.724+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c40691f0 con 0x7f55c40b5330 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.724+0000 7f55baffd640 1 -- 172.21.15.87:0/3723970565 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55b4030ac0 con 0x7f55c40b5330 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.725+0000 7f55baffd640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55a806be30 0x7f55a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.725+0000 7f55baffd640 1 -- 172.21.15.87:0/3723970565 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f55b40ab790 con 0x7f55c40b5330 2024-05-09T08:02:39.743 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.725+0000 7f55ca46e640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55a806be30 0x7f55a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:39.744 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.725+0000 7f55ca46e640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55a806be30 0x7f55a806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009aa0 tx=0x7f55c0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:39.746 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.729+0000 7f55baffd640 1 -- 172.21.15.87:0/3723970565 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f55b407a140 con 0x7f55c40b5330 2024-05-09T08:02:39.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.942+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55c40af340 con 0x7f55c40b5330 2024-05-09T08:02:39.959 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.942+0000 7f55baffd640 1 -- 172.21.15.87:0/3723970565 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7f55b4079a40 con 0x7f55c40b5330 2024-05-09T08:02:39.959 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:39.960 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/138437726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":138437726},{"type":"v1","addr":"172.21.15.110:6833","nonce":138437726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T07:54:36.428491+0000","modified":"2024-05-09T07:54:38.820976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2148825985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2148825985},{"type":"v1","addr":"172.21.15.87:6835","nonce":2148825985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-05-09T08:02:39.960 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2024-05-09T08:02:39.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.944+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55a806be30 msgr2=0x7f55a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.944+0000 7f55cc6d2640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55a806be30 0x7f55a806e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009aa0 tx=0x7f55c0009190 comp rx=0 tx=0).stop 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.944+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 msgr2=0x7f55c4148c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.944+0000 7f55cc6d2640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 0x7f55c4148c00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f55b402a220 tx=0x7f55b40046c0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.944+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 shutdown_connections 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.945+0000 7f55cc6d2640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f55a806be30 0x7f55a806e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.945+0000 7f55cc6d2640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55c40b5e60 0x7f55c41db8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.945+0000 7f55cc6d2640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f55c40b5330 0x7f55c4148c00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.945+0000 7f55cc6d2640 1 --2- 172.21.15.87:0/3723970565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55c40b2770 0x7f55c41defc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.945+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 >> 172.21.15.87:0/3723970565 conn(0x7f55c406c6a0 msgr2=0x7f55c414fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.945+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 shutdown_connections 2024-05-09T08:02:39.962 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:39.945+0000 7f55cc6d2640 1 -- 172.21.15.87:0/3723970565 wait complete. 2024-05-09T08:02:39.973 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T08:02:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.055+0000 7f9c19bc8640 1 Processor -- start 2024-05-09T08:02:40.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c19bc8640 1 -- start start 2024-05-09T08:02:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c19bc8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9c140af900 0x7f9c140b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c19bc8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 0x7f9c140b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c19bc8640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9c140b4210 0x7f9c140b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c19bc8640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f9c140b3d80 con 0x7f9c140b4210 2024-05-09T08:02:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c19bc8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f9c140b0ed0 con 0x7f9c140af900 2024-05-09T08:02:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c19bc8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9c140b3770 con 0x7f9c140af1b0 2024-05-09T08:02:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c13fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9c140b4210 0x7f9c140b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c13fff640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f9c140b4210 0x7f9c140b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33984/0 (socket says 172.21.15.87:33984) 2024-05-09T08:02:40.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.056+0000 7f9c13fff640 1 -- 172.21.15.87:0/319086645 learned_addr learned my addr 172.21.15.87:0/319086645 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c137fe640 1 --2- 172.21.15.87:0/319086645 >> v2:172.21.15.110:3300/0 conn(0x7f9c140af900 0x7f9c140b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c12ffd640 1 --2- 172.21.15.87:0/319086645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 0x7f9c140b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c13fff640 1 -- 172.21.15.87:0/319086645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 msgr2=0x7f9c140b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c13fff640 1 --2- 172.21.15.87:0/319086645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 0x7f9c140b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c13fff640 1 -- 172.21.15.87:0/319086645 >> v2:172.21.15.110:3300/0 conn(0x7f9c140af900 msgr2=0x7f9c140b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c13fff640 1 --2- 172.21.15.87:0/319086645 >> v2:172.21.15.110:3300/0 conn(0x7f9c140af900 0x7f9c140b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c13fff640 1 -- 172.21.15.87:0/319086645 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c140b4ba0 con 0x7f9c140b4210 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c137fe640 1 --2- 172.21.15.87:0/319086645 >> v2:172.21.15.110:3300/0 conn(0x7f9c140af900 0x7f9c140b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c13fff640 1 --2- 172.21.15.87:0/319086645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 0x7f9c140b4660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9c140b6510 tx=0x7f9c0c02c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e84c574c3894e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.057+0000 7f9c127fc640 1 -- 172.21.15.87:0/319086645 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c009600 con 0x7f9c140b4210 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c127fc640 1 -- 172.21.15.87:0/319086645 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9c0c0097a0 con 0x7f9c140b4210 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c127fc640 1 -- 172.21.15.87:0/319086645 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c009b90 con 0x7f9c140b4210 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c19bc8640 1 -- 172.21.15.87:0/319086645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 msgr2=0x7f9c140b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/319086645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 0x7f9c140b4660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9c140b6510 tx=0x7f9c0c02c7c0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c19bc8640 1 -- 172.21.15.87:0/319086645 shutdown_connections 2024-05-09T08:02:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/319086645 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 0x7f9c140b4660 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/319086645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 0x7f9c140b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/319086645 >> v2:172.21.15.110:3300/0 conn(0x7f9c140af900 0x7f9c140b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c19bc8640 1 -- 172.21.15.87:0/319086645 >> 172.21.15.87:0/319086645 conn(0x7f9c1406c6a0 msgr2=0x7f9c1406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c19bc8640 1 -- 172.21.15.87:0/319086645 shutdown_connections 2024-05-09T08:02:40.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.058+0000 7f9c19bc8640 1 -- 172.21.15.87:0/319086645 wait complete. 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.059+0000 7f9c19bc8640 1 Processor -- start 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.059+0000 7f9c19bc8640 1 -- start start 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c19bc8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 0x7f9c140b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c19bc8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c140af900 0x7f9c1409c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c19bc8640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 0x7f9c1409b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c19bc8640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f9c140afce0 con 0x7f9c140b4210 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c19bc8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9c140b3a10 con 0x7f9c140af900 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c19bc8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f9c140ade30 con 0x7f9c140af1b0 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c13fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 0x7f9c1409b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c13fff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 0x7f9c1409b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33996/0 (socket says 172.21.15.87:33996) 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c13fff640 1 -- 172.21.15.87:0/1390074692 learned_addr learned my addr 172.21.15.87:0/1390074692 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c137fe640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 0x7f9c140b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c12ffd640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c140af900 0x7f9c1409c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.080 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c13fff640 1 -- 172.21.15.87:0/1390074692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 msgr2=0x7f9c140b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c13fff640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 0x7f9c140b6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c13fff640 1 -- 172.21.15.87:0/1390074692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c140af900 msgr2=0x7f9c1409c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c13fff640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c140af900 0x7f9c1409c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c13fff640 1 -- 172.21.15.87:0/1390074692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1409aae0 con 0x7f9c140b4210 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.060+0000 7f9c13fff640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 0x7f9c1409b7c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c02c800 tx=0x7f9c0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.061+0000 7f9c0bfff640 1 -- 172.21.15.87:0/1390074692 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c043020 con 0x7f9c140b4210 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.061+0000 7f9c0bfff640 1 -- 172.21.15.87:0/1390074692 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9c0c0349b0 con 0x7f9c140b4210 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.061+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1409cf60 con 0x7f9c140b4210 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.061+0000 7f9c0bfff640 1 -- 172.21.15.87:0/1390074692 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c009600 con 0x7f9c140b4210 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.061+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1409ca00 con 0x7f9c140b4210 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.062+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c140691f0 con 0x7f9c140b4210 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.062+0000 7f9c0bfff640 1 -- 172.21.15.87:0/1390074692 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c0c046020 con 0x7f9c140b4210 2024-05-09T08:02:40.081 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.063+0000 7f9c0bfff640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9bf406be60 0x7f9bf406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.063+0000 7f9c137fe640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9bf406be60 0x7f9bf406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.063+0000 7f9c0bfff640 1 -- 172.21.15.87:0/1390074692 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f9c0c0ac0c0 con 0x7f9c140b4210 2024-05-09T08:02:40.082 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.063+0000 7f9c137fe640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9bf406be60 0x7f9bf406e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c140b8150 tx=0x7f9c04008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:40.083 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.067+0000 7f9c0bfff640 1 -- 172.21.15.87:0/1390074692 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9c0c04d030 con 0x7f9c140b4210 2024-05-09T08:02:40.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.279+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c1409cc90 con 0x7f9c140b4210 2024-05-09T08:02:40.296 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.279+0000 7f9c0bfff640 1 -- 172.21.15.87:0/1390074692 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3527 (secure 0 0 0) 0x7f9c0c036e40 con 0x7f9c140b4210 2024-05-09T08:02:40.296 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:40.296 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/138437726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":138437726},{"type":"v1","addr":"172.21.15.110:6833","nonce":138437726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T07:54:36.428491+0000","modified":"2024-05-09T07:54:38.820976+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.87:6835/2148825985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6834","nonce":2148825985},{"type":"v1","addr":"172.21.15.87:6835","nonce":2148825985}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-05-09T08:02:40.296 INFO:teuthology.orchestra.run.smithi087.stderr:dumped fsmap epoch 7 2024-05-09T08:02:40.298 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9bf406be60 msgr2=0x7f9bf406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9bf406be60 0x7f9bf406e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c140b8150 tx=0x7f9c04008040 comp rx=0 tx=0).stop 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 msgr2=0x7f9c1409b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 0x7f9c1409b7c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c02c800 tx=0x7f9c0c004a40 comp rx=0 tx=0).stop 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 shutdown_connections 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f9bf406be60 0x7f9bf406e320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c140b4210 0x7f9c1409b7c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c140af900 0x7f9c1409c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 --2- 172.21.15.87:0/1390074692 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c140af1b0 0x7f9c140b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.281+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 >> 172.21.15.87:0/1390074692 conn(0x7f9c1406c6a0 msgr2=0x7f9c140b9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.282+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 shutdown_connections 2024-05-09T08:02:40.299 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.282+0000 7f9c19bc8640 1 -- 172.21.15.87:0/1390074692 wait complete. 2024-05-09T08:02:40.310 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T08:02:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.392+0000 7f8b8d753640 1 Processor -- start 2024-05-09T08:02:40.409 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b8d753640 1 -- start start 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b8d753640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b5400 0x7f8b880b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b8d753640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b880b4660 0x7f8b88147900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b8d753640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b880b57e0 con 0x7f8b880b8d50 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b8d753640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f8b88147e40 con 0x7f8b880b4660 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b8d753640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8b880b5b80 con 0x7f8b880b5400 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b867fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b880b4660 0x7f8b88147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b867fc640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8b880b4660 0x7f8b88147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:33998/0 (socket says 172.21.15.87:33998) 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b867fc640 1 -- 172.21.15.87:0/3928165223 learned_addr learned my addr 172.21.15.87:0/3928165223 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.393+0000 7f8b86ffd640 1 --2- 172.21.15.87:0/3928165223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b5400 0x7f8b880b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.412 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.394+0000 7f8b867fc640 1 -- 172.21.15.87:0/3928165223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b5400 msgr2=0x7f8b880b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.394+0000 7f8b867fc640 1 --2- 172.21.15.87:0/3928165223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b5400 0x7f8b880b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.394+0000 7f8b867fc640 1 -- 172.21.15.87:0/3928165223 >> v1:172.21.15.110:6789/0 conn(0x7f8b880b8d50 legacy=0x7f8b880b91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.394+0000 7f8b867fc640 1 -- 172.21.15.87:0/3928165223 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b880b98f0 con 0x7f8b880b4660 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.394+0000 7f8b867fc640 1 --2- 172.21.15.87:0/3928165223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b4660 0x7f8b88147900 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009870 tx=0x7f8b7c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63da5cdd1aa59d8d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.394+0000 7f8b85ffb640 1 -- 172.21.15.87:0/3928165223 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c037070 con 0x7f8b880b4660 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.394+0000 7f8b85ffb640 1 -- 172.21.15.87:0/3928165223 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8b7c032440 con 0x7f8b880b4660 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.394+0000 7f8b85ffb640 1 -- 172.21.15.87:0/3928165223 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c032830 con 0x7f8b880b4660 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.395+0000 7f8b8d753640 1 -- 172.21.15.87:0/3928165223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b4660 msgr2=0x7f8b88147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.395+0000 7f8b8d753640 1 --2- 172.21.15.87:0/3928165223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b4660 0x7f8b88147900 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009870 tx=0x7f8b7c02a1c0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.395+0000 7f8b8d753640 1 -- 172.21.15.87:0/3928165223 shutdown_connections 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.395+0000 7f8b8d753640 1 --2- 172.21.15.87:0/3928165223 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b4660 0x7f8b88147900 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.395+0000 7f8b8d753640 1 --2- 172.21.15.87:0/3928165223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b5400 0x7f8b880b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.395+0000 7f8b8d753640 1 -- 172.21.15.87:0/3928165223 >> 172.21.15.87:0/3928165223 conn(0x7f8b88067900 msgr2=0x7f8b880bd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:40.413 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.395+0000 7f8b8d753640 1 -- 172.21.15.87:0/3928165223 shutdown_connections 2024-05-09T08:02:40.414 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.395+0000 7f8b8d753640 1 -- 172.21.15.87:0/3928165223 wait complete. 2024-05-09T08:02:40.416 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.396+0000 7f8b8d753640 1 Processor -- start 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.396+0000 7f8b8d753640 1 -- start start 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b8d753640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b4660 0x7f8b881e0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b8d753640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b880b5400 0x7f8b881490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b8d753640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b8d50 0x7f8b8813bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b8d753640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f8b880b3970 con 0x7f8b880b8d50 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b8d753640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8b880b4010 con 0x7f8b880b5400 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b8d753640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f8b880b3af0 con 0x7f8b880b4660 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b8d50 0x7f8b8813bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b877fe640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b8d50 0x7f8b8813bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34002/0 (socket says 172.21.15.87:34002) 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b877fe640 1 -- 172.21.15.87:0/1392817099 learned_addr learned my addr 172.21.15.87:0/1392817099 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b867fc640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b880b5400 0x7f8b881490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b86ffd640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b4660 0x7f8b881e0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.417 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b877fe640 1 -- 172.21.15.87:0/1392817099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b4660 msgr2=0x7f8b881e0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b877fe640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b4660 0x7f8b881e0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b877fe640 1 -- 172.21.15.87:0/1392817099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b880b5400 msgr2=0x7f8b881490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b877fe640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b880b5400 0x7f8b881490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.397+0000 7f8b877fe640 1 -- 172.21.15.87:0/1392817099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8814bd30 con 0x7f8b880b8d50 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.398+0000 7f8b877fe640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b8d50 0x7f8b8813bfd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800c6e0 tx=0x7f8b7800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.398+0000 7f8b6f7fe640 1 -- 172.21.15.87:0/1392817099 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78003b70 con 0x7f8b880b8d50 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.398+0000 7f8b6f7fe640 1 -- 172.21.15.87:0/1392817099 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8b78003d30 con 0x7f8b880b8d50 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.398+0000 7f8b6f7fe640 1 -- 172.21.15.87:0/1392817099 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78005330 con 0x7f8b880b8d50 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.398+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b88142270 con 0x7f8b880b8d50 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.398+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8814ac70 con 0x7f8b880b8d50 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.399+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b880691f0 con 0x7f8b880b8d50 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.399+0000 7f8b6f7fe640 1 -- 172.21.15.87:0/1392817099 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b780054d0 con 0x7f8b880b8d50 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.400+0000 7f8b6f7fe640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b7406be30 0x7f8b7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.418 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.400+0000 7f8b6f7fe640 1 -- 172.21.15.87:0/1392817099 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f8b7808ac00 con 0x7f8b880b8d50 2024-05-09T08:02:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.400+0000 7f8b86ffd640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b7406be30 0x7f8b7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.400+0000 7f8b86ffd640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b7406be30 0x7f8b7406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b80006fd0 tx=0x7f8b80008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:40.421 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.404+0000 7f8b6f7fe640 1 -- 172.21.15.87:0/1392817099 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8b78091080 con 0x7f8b880b8d50 2024-05-09T08:02:40.595 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.579+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b881474a0 con 0x7f8b880b8d50 2024-05-09T08:02:40.596 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.580+0000 7f8b6f7fe640 1 -- 172.21.15.87:0/1392817099 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16820 (secure 0 0 0) 0x7f8b78058ed0 con 0x7f8b880b8d50 2024-05-09T08:02:40.597 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-05-09T08:02:40.597 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":23,"fsid":"afc7678c-ec1c-4af0-8515-296a1e5375c0","created":"2024-05-09T07:54:12.684373+0000","modified":"2024-05-09T07:55:18.551072+0000","last_up_change":"2024-05-09T07:54:24.029538+0000","last_in_change":"2024-05-09T07:54:14.932728+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T07:54:24.920922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T07:54:34.879628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T07:54:35.405648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c73afe3-24ba-499d-b59f-d0541e2feef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6801","nonce":1946784247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6803","nonce":1946784247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6807","nonce":1946784247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":1946784247},{"type":"v1","addr":"172.21.15.87:6805","nonce":1946784247}]},"public_addr":"172.21.15.87:6801/1946784247","cluster_addr":"172.21.15.87:6803/1946784247","heartbeat_back_addr":"172.21.15.87:6807/1946784247","heartbeat_front_addr":"172.21.15.87:6805/1946784247","state":["exists","up"]},{"osd":1,"uuid":"4ac91ca6-ede6-491f-8b01-252aa53ab8fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6809","nonce":2730159651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6811","nonce":2730159651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6815","nonce":2730159651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":2730159651},{"type":"v1","addr":"172.21.15.87:6813","nonce":2730159651}]},"public_addr":"172.21.15.87:6809/2730159651","cluster_addr":"172.21.15.87:6811/2730159651","heartbeat_back_addr":"172.21.15.87:6815/2730159651","heartbeat_front_addr":"172.21.15.87:6813/2730159651","state":["exists","up"]},{"osd":2,"uuid":"3671dd85-857f-46d2-807a-a4b9f1140197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6817","nonce":2336174143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6819","nonce":2336174143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6823","nonce":2336174143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":2336174143},{"type":"v1","addr":"172.21.15.87:6821","nonce":2336174143}]},"public_addr":"172.21.15.87:6817/2336174143","cluster_addr":"172.21.15.87:6819/2336174143","heartbeat_back_addr":"172.21.15.87:6823/2336174143","heartbeat_front_addr":"172.21.15.87:6821/2336174143","state":["exists","up"]},{"osd":3,"uuid":"8dbf1cd3-1093-4f15-a332-43ae83f6b0c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6825","nonce":61362060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6827","nonce":61362060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6831","nonce":61362060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":61362060},{"type":"v1","addr":"172.21.15.87:6829","nonce":61362060}]},"public_addr":"172.21.15.87:6825/61362060","cluster_addr":"172.21.15.87:6827/61362060","heartbeat_back_addr":"172.21.15.87:6831/61362060","heartbeat_front_addr":"172.21.15.87:6829/61362060","state":["exists","up"]},{"osd":4,"uuid":"84871857-3b5d-44d0-b7ce-0ca847641d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6823","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6825","nonce":1484209221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6827","nonce":1484209221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6831","nonce":1484209221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1484209221},{"type":"v1","addr":"172.21.15.110:6829","nonce":1484209221}]},"public_addr":"172.21.15.110:6825/1484209221","cluster_addr":"172.21.15.110:6827/1484209221","heartbeat_back_addr":"172.21.15.110:6831/1484209221","heartbeat_front_addr":"172.21.15.110:6829/1484209221","state":["exists","up"]},{"osd":5,"uuid":"26198799-f42a-46f6-a18b-02d10eda294f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6801","nonce":1937011744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6803","nonce":1937011744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6807","nonce":1937011744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1937011744},{"type":"v1","addr":"172.21.15.110:6805","nonce":1937011744}]},"public_addr":"172.21.15.110:6801/1937011744","cluster_addr":"172.21.15.110:6803/1937011744","heartbeat_back_addr":"172.21.15.110:6807/1937011744","heartbeat_front_addr":"172.21.15.110:6805/1937011744","state":["exists","up"]},{"osd":6,"uuid":"3250b67e-2980-4f93-ac34-4ef4b1f3da18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6809","nonce":1772840831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6811","nonce":1772840831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6815","nonce":1772840831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1772840831},{"type":"v1","addr":"172.21.15.110:6813","nonce":1772840831}]},"public_addr":"172.21.15.110:6809/1772840831","cluster_addr":"172.21.15.110:6811/1772840831","heartbeat_back_addr":"172.21.15.110:6815/1772840831","heartbeat_front_addr":"172.21.15.110:6813/1772840831","state":["exists","up"]},{"osd":7,"uuid":"a6f75777-0493-473d-9a0c-fb138f27cd80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6817","nonce":628113560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6819","nonce":628113560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6824","nonce":628113560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":628113560},{"type":"v1","addr":"172.21.15.110:6821","nonce":628113560}]},"public_addr":"172.21.15.110:6817/628113560","cluster_addr":"172.21.15.110:6819/628113560","heartbeat_back_addr":"172.21.15.110:6824/628113560","heartbeat_front_addr":"172.21.15.110:6821/628113560","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.052027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.104364+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.127837+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.105676+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.131698+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.064085+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.062582+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T07:54:20.060997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T08:02:40.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b7406be30 msgr2=0x7f8b7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b7406be30 0x7f8b7406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8b80006fd0 tx=0x7f8b80008040 comp rx=0 tx=0).stop 2024-05-09T08:02:40.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b8d50 msgr2=0x7f8b8813bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b8d50 0x7f8b8813bfd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800c6e0 tx=0x7f8b7800cba0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 shutdown_connections 2024-05-09T08:02:40.599 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f8b7406be30 0x7f8b7406e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8b880b8d50 0x7f8b8813bfd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b880b5400 0x7f8b881490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 --2- 172.21.15.87:0/1392817099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b880b4660 0x7f8b881e0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 >> 172.21.15.87:0/1392817099 conn(0x7f8b88067900 msgr2=0x7f8b881d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:40.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 shutdown_connections 2024-05-09T08:02:40.600 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.582+0000 7f8b8d753640 1 -- 172.21.15.87:0/1392817099 wait complete. 2024-05-09T08:02:40.611 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-09T08:02:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.695+0000 7f2eedca5640 1 Processor -- start 2024-05-09T08:02:40.712 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.695+0000 7f2eedca5640 1 -- start start 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2eedca5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee80b4dd0 0x7f2ee80b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2eedca5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2ee8141ec0 0x7f2ee8147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2eedca5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee80b4780 con 0x7f2ee80b56f0 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2eedca5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee80b6090 con 0x7f2ee8141ec0 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2eedca5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee80b6370 con 0x7f2ee80b4dd0 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2ee77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee80b4dd0 0x7f2ee80b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2ee7fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2ee8141ec0 0x7f2ee8147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2ee77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee80b4dd0 0x7f2ee80b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.87:58916/0 (socket says 172.21.15.87:58916) 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2ee77fe640 1 -- 172.21.15.87:0/2647131268 learned_addr learned my addr 172.21.15.87:0/2647131268 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2ee77fe640 1 -- 172.21.15.87:0/2647131268 >> v2:172.21.15.110:3300/0 conn(0x7f2ee8141ec0 msgr2=0x7f2ee8147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2ee77fe640 1 --2- 172.21.15.87:0/2647131268 >> v2:172.21.15.110:3300/0 conn(0x7f2ee8141ec0 0x7f2ee8147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.714 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2ee77fe640 1 -- 172.21.15.87:0/2647131268 >> v1:172.21.15.110:6789/0 conn(0x7f2ee80b56f0 legacy=0x7f2ee81417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2ee77fe640 1 -- 172.21.15.87:0/2647131268 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee80b5e20 con 0x7f2ee80b4dd0 2024-05-09T08:02:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.696+0000 7f2ee7fff640 1 --2- 172.21.15.87:0/2647131268 >> v2:172.21.15.110:3300/0 conn(0x7f2ee8141ec0 0x7f2ee8147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:02:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.697+0000 7f2ee77fe640 1 --2- 172.21.15.87:0/2647131268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee80b4dd0 0x7f2ee80b51b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80098a0 tx=0x7f2ed802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b1b3c096599ed5b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.697+0000 7f2ee67fc640 1 -- 172.21.15.87:0/2647131268 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8037070 con 0x7f2ee80b4dd0 2024-05-09T08:02:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.697+0000 7f2ee67fc640 1 -- 172.21.15.87:0/2647131268 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2ed8032440 con 0x7f2ee80b4dd0 2024-05-09T08:02:40.715 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.697+0000 7f2ee67fc640 1 -- 172.21.15.87:0/2647131268 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8032830 con 0x7f2ee80b4dd0 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.698+0000 7f2eedca5640 1 -- 172.21.15.87:0/2647131268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee80b4dd0 msgr2=0x7f2ee80b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.698+0000 7f2eedca5640 1 --2- 172.21.15.87:0/2647131268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee80b4dd0 0x7f2ee80b51b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80098a0 tx=0x7f2ed802a200 comp rx=0 tx=0).stop 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.698+0000 7f2eedca5640 1 -- 172.21.15.87:0/2647131268 shutdown_connections 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.698+0000 7f2eedca5640 1 --2- 172.21.15.87:0/2647131268 >> v2:172.21.15.110:3300/0 conn(0x7f2ee8141ec0 0x7f2ee8147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.698+0000 7f2eedca5640 1 --2- 172.21.15.87:0/2647131268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee80b4dd0 0x7f2ee80b51b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.698+0000 7f2eedca5640 1 -- 172.21.15.87:0/2647131268 >> 172.21.15.87:0/2647131268 conn(0x7f2ee80677b0 msgr2=0x7f2ee80bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.698+0000 7f2eedca5640 1 -- 172.21.15.87:0/2647131268 shutdown_connections 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.698+0000 7f2eedca5640 1 -- 172.21.15.87:0/2647131268 wait complete. 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.699+0000 7f2eedca5640 1 Processor -- start 2024-05-09T08:02:40.718 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.699+0000 7f2eedca5640 1 -- start start 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.699+0000 7f2eedca5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee80b4dd0 0x7f2ee81e0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2eedca5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b56f0 0x7f2ee81e0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2eedca5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee8141ec0 0x7f2ee8144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2eedca5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee81483b0 con 0x7f2ee80b56f0 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2eedca5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee8148230 con 0x7f2ee80b4dd0 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2eedca5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee8148530 con 0x7f2ee8141ec0 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b56f0 0x7f2ee81e0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee80b4dd0 0x7f2ee81e0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee6ffd640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b56f0 0x7f2ee81e0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34006/0 (socket says 172.21.15.87:34006) 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee6ffd640 1 -- 172.21.15.87:0/822208963 learned_addr learned my addr 172.21.15.87:0/822208963 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee7fff640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee8141ec0 0x7f2ee8144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee6ffd640 1 -- 172.21.15.87:0/822208963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee8141ec0 msgr2=0x7f2ee8144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee6ffd640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee8141ec0 0x7f2ee8144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee6ffd640 1 -- 172.21.15.87:0/822208963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee80b4dd0 msgr2=0x7f2ee81e0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.719 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee6ffd640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee80b4dd0 0x7f2ee81e0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee6ffd640 1 -- 172.21.15.87:0/822208963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee8143e30 con 0x7f2ee80b56f0 2024-05-09T08:02:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee77fe640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee80b4dd0 0x7f2ee81e0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T08:02:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ee6ffd640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b56f0 0x7f2ee81e0f30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00c400 tx=0x7f2edc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ecffff640 1 -- 172.21.15.87:0/822208963 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0052d0 con 0x7f2ee80b56f0 2024-05-09T08:02:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ecffff640 1 -- 172.21.15.87:0/822208963 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2edc005490 con 0x7f2ee80b56f0 2024-05-09T08:02:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee81450c0 con 0x7f2ee80b56f0 2024-05-09T08:02:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2ecffff640 1 -- 172.21.15.87:0/822208963 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc007280 con 0x7f2ee80b56f0 2024-05-09T08:02:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.700+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee81440d0 con 0x7f2ee80b56f0 2024-05-09T08:02:40.720 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.701+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee80691f0 con 0x7f2ee80b56f0 2024-05-09T08:02:40.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.702+0000 7f2ecffff640 1 -- 172.21.15.87:0/822208963 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2edc007420 con 0x7f2ee80b56f0 2024-05-09T08:02:40.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.702+0000 7f2ecffff640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2ed406be30 0x7f2ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:40.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.702+0000 7f2ecffff640 1 -- 172.21.15.87:0/822208963 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5854+0+0 (secure 0 0 0) 0x7f2edc08a290 con 0x7f2ee80b56f0 2024-05-09T08:02:40.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.702+0000 7f2ee77fe640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2ed406be30 0x7f2ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:40.721 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.703+0000 7f2ee77fe640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2ed406be30 0x7f2ed406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8034000 tx=0x7f2ed802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:40.723 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.706+0000 7f2ecffff640 1 -- 172.21.15.87:0/822208963 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2edc0585f0 con 0x7f2ee80b56f0 2024-05-09T08:02:40.940 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.923+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2ee8146b00 con 0x7f2ee80b56f0 2024-05-09T08:02:40.944 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.927+0000 7f2ecffff640 1 -- 172.21.15.87:0/822208963 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f2edc05c8f0 con 0x7f2ee80b56f0 2024-05-09T08:02:40.944 INFO:teuthology.orchestra.run.smithi087.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2ed406be30 msgr2=0x7f2ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2ed406be30 0x7f2ed406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8034000 tx=0x7f2ed802e000 comp rx=0 tx=0).stop 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b56f0 msgr2=0x7f2ee81e0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b56f0 0x7f2ee81e0f30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00c400 tx=0x7f2edc00c800 comp rx=0 tx=0).stop 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 shutdown_connections 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f2ed406be30 0x7f2ed406e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee8141ec0 0x7f2ee8144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2ee80b56f0 0x7f2ee81e0f30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 --2- 172.21.15.87:0/822208963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee80b4dd0 0x7f2ee81e0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 >> 172.21.15.87:0/822208963 conn(0x7f2ee80677b0 msgr2=0x7f2ee80b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 shutdown_connections 2024-05-09T08:02:40.947 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:40.930+0000 7f2eedca5640 1 -- 172.21.15.87:0/822208963 wait complete. 2024-05-09T08:02:40.959 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T08:02:41.017 INFO:tasks.ceph.mds.a.smithi087.stdout:starting mds.a at 2024-05-09T08:02:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.048+0000 7f4676514640 1 Processor -- start 2024-05-09T08:02:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.048+0000 7f4676514640 1 -- start start 2024-05-09T08:02:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.048+0000 7f4676514640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46700b4dd0 0x7f46700b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.048+0000 7f4676514640 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46700b4780 con 0x7f46700b56f0 2024-05-09T08:02:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.048+0000 7f4676514640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46700b5e20 con 0x7f4670141ec0 2024-05-09T08:02:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.048+0000 7f4676514640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f46700b6090 con 0x7f46700b4dd0 2024-05-09T08:02:41.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f4667fff640 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f46700b56f0 0x7f46701417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:49334/0 (socket says 172.21.15.87:49334) 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f4667fff640 1 -- 172.21.15.87:0/2023426662 learned_addr learned my addr 172.21.15.87:0/2023426662 (peer_addr_for_me v1:172.21.15.87:0/0) 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466ffff640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46700b4dd0 0x7f46700b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318963770 0 0) 0x7f46700b4780 con 0x7f46700b56f0 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f465c003520 con 0x7f46700b56f0 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1407588912 0 0) 0x7f465c003520 con 0x7f46700b56f0 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46700b4dd0 msgr2=0x7f46700b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46700b4dd0 0x7f46700b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 >> v1:172.21.15.110:6789/0 conn(0x7f4670141ec0 legacy=0x7f4670147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46700b6370 con 0x7f46700b56f0 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3748185654 0 0) 0x7f4658001670 con 0x7f46700b56f0 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 >> v1:172.21.15.87:6789/0 conn(0x7f46700b56f0 legacy=0x7f46701417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c0039e0 0x7f465c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46700b4dd0 0x7f465c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:41.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f465c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f46700b6090 con 0x7f465c004d40 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f465c00baf0 con 0x7f465c0039e0 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f465c00bcf0 con 0x7f46700b4dd0 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f4674ab1640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f465c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f466ffff640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c0039e0 0x7f465c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f4667fff640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46700b4dd0 0x7f465c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f4674ab1640 1 -- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46700b4dd0 msgr2=0x7f465c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f4674ab1640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46700b4dd0 0x7f465c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f4674ab1640 1 -- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c0039e0 msgr2=0x7f465c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f4674ab1640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f465c0039e0 0x7f465c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.049+0000 7f4674ab1640 1 -- 172.21.15.87:0/2023426662 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c003520 con 0x7f465c004d40 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.050+0000 7f4674ab1640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f465c0051c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4668001e20 tx=0x7f465c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665d3005468421b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.050+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668001a70 con 0x7f465c004d40 2024-05-09T08:02:41.070 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.050+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f466802ae40 con 0x7f465c004d40 2024-05-09T08:02:41.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.050+0000 7f466f7fe640 1 -- 172.21.15.87:0/2023426662 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668003bd0 con 0x7f465c004d40 2024-05-09T08:02:41.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.051+0000 7f4676514640 1 -- 172.21.15.87:0/2023426662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 msgr2=0x7f465c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:41.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.051+0000 7f4676514640 1 --2- 172.21.15.87:0/2023426662 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f465c0051c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4668001e20 tx=0x7f465c005830 comp rx=0 tx=0).stop 2024-05-09T08:02:41.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.051+0000 7f4674ab1640 1 -- 172.21.15.87:0/2023426662 reap_dead start 2024-05-09T08:02:41.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.051+0000 7f4676514640 1 -- 172.21.15.87:0/2023426662 shutdown_connections 2024-05-09T08:02:41.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.051+0000 7f4676514640 1 -- 172.21.15.87:0/2023426662 >> 172.21.15.87:0/2023426662 conn(0x7f46700677b0 msgr2=0x7f46700bd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:41.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.051+0000 7f4676514640 1 -- 172.21.15.87:0/2023426662 shutdown_connections 2024-05-09T08:02:41.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.051+0000 7f4676514640 1 -- 172.21.15.87:0/2023426662 wait complete. 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.052+0000 7f4676514640 1 Processor -- start 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.052+0000 7f4676514640 1 -- start start 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.052+0000 7f4676514640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f467014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.052+0000 7f4676514640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f467014b570 0x7f46701e0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.052+0000 7f4676514640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46701e0c60 0x7f467013b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f4676514640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f4670148580 con 0x7f465c004d40 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f4676514640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4670148400 con 0x7f467014b570 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f4676514640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f467014a770 con 0x7f46701e0c60 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f467014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f467014ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:34044/0 (socket says 172.21.15.87:34044) 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466ffff640 1 -- 172.21.15.87:0/1338448531 learned_addr learned my addr 172.21.15.87:0/1338448531 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f4674ab1640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46701e0c60 0x7f467013b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:41.074 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f4667fff640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f467014b570 0x7f46701e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466ffff640 1 -- 172.21.15.87:0/1338448531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46701e0c60 msgr2=0x7f467013b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466ffff640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46701e0c60 0x7f467013b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466ffff640 1 -- 172.21.15.87:0/1338448531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f467014b570 msgr2=0x7f46701e0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466ffff640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f467014b570 0x7f46701e0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466ffff640 1 -- 172.21.15.87:0/1338448531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46701d0e10 con 0x7f465c004d40 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466ffff640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f467014ac90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f46600119a0 tx=0x7f4660011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466d7fa640 1 -- 172.21.15.87:0/1338448531 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466000fa90 con 0x7f465c004d40 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466d7fa640 1 -- 172.21.15.87:0/1338448531 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f466000fc30 con 0x7f465c004d40 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467014a280 con 0x7f465c004d40 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f466d7fa640 1 -- 172.21.15.87:0/1338448531 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660014440 con 0x7f465c004d40 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.053+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467014b9f0 con 0x7f465c004d40 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.054+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46700691f0 con 0x7f465c004d40 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.055+0000 7f466d7fa640 1 -- 172.21.15.87:0/1338448531 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4660012040 con 0x7f465c004d40 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.055+0000 7f466d7fa640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f465006be30 0x7f465006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:41.075 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.055+0000 7f4667fff640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f465006be30 0x7f465006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.055+0000 7f466d7fa640 1 -- 172.21.15.87:0/1338448531 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f466008b440 con 0x7f465c004d40 2024-05-09T08:02:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.056+0000 7f4667fff640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f465006be30 0x7f465006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f467014bec0 tx=0x7f4658000fa0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:41.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.059+0000 7f466d7fa640 1 -- 172.21.15.87:0/1338448531 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4660019030 con 0x7f465c004d40 2024-05-09T08:02:41.284 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.268+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f467013f4e0 con 0x7f465c004d40 2024-05-09T08:02:41.948 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.931+0000 7f466d7fa640 1 -- 172.21.15.87:0/1338448531 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f4660059740 con 0x7f465c004d40 2024-05-09T08:02:41.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f465006be30 msgr2=0x7f465006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:41.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f465006be30 0x7f465006e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f467014bec0 tx=0x7f4658000fa0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 msgr2=0x7f467014ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:41.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f467014ac90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f46600119a0 tx=0x7f4660011e60 comp rx=0 tx=0).stop 2024-05-09T08:02:41.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 shutdown_connections 2024-05-09T08:02:41.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f465006be30 0x7f465006e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46701e0c60 0x7f467013b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f467014b570 0x7f46701e0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 --2- 172.21.15.87:0/1338448531 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f465c004d40 0x7f467014ac90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:41.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 >> 172.21.15.87:0/1338448531 conn(0x7f46700677b0 msgr2=0x7f4670141580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:41.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 shutdown_connections 2024-05-09T08:02:41.952 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:41.934+0000 7f4676514640 1 -- 172.21.15.87:0/1338448531 wait complete. 2024-05-09T08:02:41.963 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T08:02:42.068 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.052+0000 7f5a8e91d640 1 Processor -- start 2024-05-09T08:02:42.069 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.052+0000 7f5a8e91d640 1 -- start start 2024-05-09T08:02:42.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.052+0000 7f5a8e91d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5a88149380 0x7f5a880b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:42.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.052+0000 7f5a8e91d640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a88073030 0x7f5a880b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:42.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.052+0000 7f5a8e91d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8806eb60 con 0x7f5a8806e780 2024-05-09T08:02:42.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.052+0000 7f5a8e91d640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7f5a880b6670 con 0x7f5a88073030 2024-05-09T08:02:42.071 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.052+0000 7f5a8e91d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7f5a880b6300 con 0x7f5a88149380 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.053+0000 7f5a8ceba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a88073030 0x7f5a880b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.053+0000 7f5a8ceba640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5a88073030 0x7f5a880b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52808/0 (socket says 172.21.15.87:52808) 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.053+0000 7f5a8ceba640 1 -- 172.21.15.87:0/3298205017 learned_addr learned my addr 172.21.15.87:0/3298205017 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.053+0000 7f5a7ffff640 1 --2- 172.21.15.87:0/3298205017 >> v2:172.21.15.110:3300/0 conn(0x7f5a88149380 0x7f5a880b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.053+0000 7f5a8ceba640 1 -- 172.21.15.87:0/3298205017 >> v2:172.21.15.110:3300/0 conn(0x7f5a88149380 msgr2=0x7f5a880b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.053+0000 7f5a8ceba640 1 --2- 172.21.15.87:0/3298205017 >> v2:172.21.15.110:3300/0 conn(0x7f5a88149380 0x7f5a880b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.053+0000 7f5a8ceba640 1 -- 172.21.15.87:0/3298205017 >> v1:172.21.15.110:6789/0 conn(0x7f5a8806e780 legacy=0x7f5a88148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.053+0000 7f5a8ceba640 1 -- 172.21.15.87:0/3298205017 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a880b7800 con 0x7f5a88073030 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a8ceba640 1 --2- 172.21.15.87:0/3298205017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 0x7f5a880b1880 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5a8806c1b0 tx=0x7f5a8002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977160634b1b2e26 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a877fe640 1 -- 172.21.15.87:0/3298205017 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80036070 con 0x7f5a88073030 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a877fe640 1 -- 172.21.15.87:0/3298205017 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5a80031600 con 0x7f5a88073030 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a877fe640 1 -- 172.21.15.87:0/3298205017 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a800319f0 con 0x7f5a88073030 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3298205017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 msgr2=0x7f5a880b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:42.072 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a8e91d640 1 --2- 172.21.15.87:0/3298205017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 0x7f5a880b1880 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5a8806c1b0 tx=0x7f5a8002a6a0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3298205017 shutdown_connections 2024-05-09T08:02:42.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a8e91d640 1 --2- 172.21.15.87:0/3298205017 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 0x7f5a880b1880 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a8e91d640 1 --2- 172.21.15.87:0/3298205017 >> v2:172.21.15.110:3300/0 conn(0x7f5a88149380 0x7f5a880b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3298205017 >> 172.21.15.87:0/3298205017 conn(0x7f5a8806b9e0 msgr2=0x7f5a880bafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:42.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3298205017 shutdown_connections 2024-05-09T08:02:42.073 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.054+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3298205017 wait complete. 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.055+0000 7f5a8e91d640 1 Processor -- start 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.055+0000 7f5a8e91d640 1 -- start start 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a8e91d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8806e780 0x7f5a8813de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a8e91d640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 0x7f5a8813eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a8e91d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a88149380 0x7f5a881db500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a8e91d640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7f5a880b2150 con 0x7f5a88073030 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a8e91d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5a880b1fd0 con 0x7f5a88149380 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a8e91d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7f5a8814ffe0 con 0x7f5a8806e780 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a7ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 0x7f5a8813eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a7ffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 0x7f5a8813eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52816/0 (socket says 172.21.15.87:52816) 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a7ffff640 1 -- 172.21.15.87:0/3201291382 learned_addr learned my addr 172.21.15.87:0/3201291382 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a8ceba640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a88149380 0x7f5a881db500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:42.076 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a87fff640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8806e780 0x7f5a8813de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a7ffff640 1 -- 172.21.15.87:0/3201291382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8806e780 msgr2=0x7f5a8813de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a7ffff640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8806e780 0x7f5a8813de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a7ffff640 1 -- 172.21.15.87:0/3201291382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a88149380 msgr2=0x7f5a881db500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a7ffff640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a88149380 0x7f5a881db500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.056+0000 7f5a7ffff640 1 -- 172.21.15.87:0/3201291382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a881401f0 con 0x7f5a88073030 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.057+0000 7f5a7ffff640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 0x7f5a8813eb30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000e9b0 tx=0x7f5a7000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.057+0000 7f5a857fa640 1 -- 172.21.15.87:0/3201291382 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70017070 con 0x7f5a88073030 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.057+0000 7f5a857fa640 1 -- 172.21.15.87:0/3201291382 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5a7000c9a0 con 0x7f5a88073030 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.057+0000 7f5a857fa640 1 -- 172.21.15.87:0/3201291382 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7000cdb0 con 0x7f5a88073030 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.057+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a881dafe0 con 0x7f5a88073030 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.057+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8813e5b0 con 0x7f5a88073030 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.058+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a880691f0 con 0x7f5a88073030 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.058+0000 7f5a857fa640 1 -- 172.21.15.87:0/3201291382 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a7001a070 con 0x7f5a88073030 2024-05-09T08:02:42.077 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.059+0000 7f5a857fa640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5a6806be30 0x7f5a6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:42.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.059+0000 7f5a857fa640 1 -- 172.21.15.87:0/3201291382 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f5a7008b1b0 con 0x7f5a88073030 2024-05-09T08:02:42.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.059+0000 7f5a87fff640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5a6806be30 0x7f5a6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:42.078 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.059+0000 7f5a87fff640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5a6806be30 0x7f5a6806e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5a78007fd0 tx=0x7f5a78009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:42.079 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.063+0000 7f5a857fa640 1 -- 172.21.15.87:0/3201291382 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5a700594b0 con 0x7f5a88073030 2024-05-09T08:02:42.254 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.237+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5a880ba0c0 con 0x7f5a88073030 2024-05-09T08:02:42.951 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.935+0000 7f5a857fa640 1 -- 172.21.15.87:0/3201291382 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f5a7005d7b0 con 0x7f5a88073030 2024-05-09T08:02:42.951 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_metadata' removed 2024-05-09T08:02:42.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5a6806be30 msgr2=0x7f5a6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:42.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5a6806be30 0x7f5a6806e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5a78007fd0 tx=0x7f5a78009040 comp rx=0 tx=0).stop 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 msgr2=0x7f5a8813eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 0x7f5a8813eb30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000e9b0 tx=0x7f5a7000ee70 comp rx=0 tx=0).stop 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 shutdown_connections 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7f5a6806be30 0x7f5a6806e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a88149380 0x7f5a881db500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5a88073030 0x7f5a8813eb30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 --2- 172.21.15.87:0/3201291382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8806e780 0x7f5a8813de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.938+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 >> 172.21.15.87:0/3201291382 conn(0x7f5a8806b9e0 msgr2=0x7f5a880b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.939+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 shutdown_connections 2024-05-09T08:02:42.956 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:42.939+0000 7f5a8e91d640 1 -- 172.21.15.87:0/3201291382 wait complete. 2024-05-09T08:02:42.972 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T08:02:43.087 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.071+0000 7fedf64a5640 1 Processor -- start 2024-05-09T08:02:43.088 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.071+0000 7fedf64a5640 1 -- start start 2024-05-09T08:02:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.071+0000 7fedf64a5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fedf00b5e60 0x7fedf00b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.071+0000 7fedf64a5640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedf00b5330 0x7fedf00b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:43.090 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.071+0000 7fedf64a5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b2770 0x7fedf0146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.071+0000 7fedf64a5640 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 -- 0x7fedf00b0470 con 0x7fedf00b5330 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.071+0000 7fedf64a5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 -- 0x7fedf00b2be0 con 0x7fedf00b5e60 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.071+0000 7fedf64a5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fedf00b1580 con 0x7fedf00b2770 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.071+0000 7fedef7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedf00b5330 0x7fedf00b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedef7fe640 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fedf00b5330 0x7fedf00b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52820/0 (socket says 172.21.15.87:52820) 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedef7fe640 1 -- 172.21.15.87:0/1765812322 learned_addr learned my addr 172.21.15.87:0/1765812322 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedf4a42640 1 --2- 172.21.15.87:0/1765812322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b2770 0x7fedf0146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedeffff640 1 --2- 172.21.15.87:0/1765812322 >> v2:172.21.15.110:3300/0 conn(0x7fedf00b5e60 0x7fedf00b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedef7fe640 1 -- 172.21.15.87:0/1765812322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b2770 msgr2=0x7fedf0146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedef7fe640 1 --2- 172.21.15.87:0/1765812322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b2770 0x7fedf0146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedef7fe640 1 -- 172.21.15.87:0/1765812322 >> v2:172.21.15.110:3300/0 conn(0x7fedf00b5e60 msgr2=0x7fedf00b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedef7fe640 1 --2- 172.21.15.87:0/1765812322 >> v2:172.21.15.110:3300/0 conn(0x7fedf00b5e60 0x7fedf00b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.091 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedef7fe640 1 -- 172.21.15.87:0/1765812322 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf00b6240 con 0x7fedf00b5330 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedf4a42640 1 --2- 172.21.15.87:0/1765812322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b2770 0x7fedf0146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedeffff640 1 --2- 172.21.15.87:0/1765812322 >> v2:172.21.15.110:3300/0 conn(0x7fedf00b5e60 0x7fedf00b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.072+0000 7fedef7fe640 1 --2- 172.21.15.87:0/1765812322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b5330 0x7fedf00b2230 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fedf006dc50 tx=0x7fede402c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e504f685bdeadd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedeeffd640 1 -- 172.21.15.87:0/1765812322 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4032700 con 0x7fedf00b5330 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedeeffd640 1 -- 172.21.15.87:0/1765812322 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fede40328a0 con 0x7fedf00b5330 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedeeffd640 1 -- 172.21.15.87:0/1765812322 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4032c90 con 0x7fedf00b5330 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedf64a5640 1 -- 172.21.15.87:0/1765812322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b5330 msgr2=0x7fedf00b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedf64a5640 1 --2- 172.21.15.87:0/1765812322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b5330 0x7fedf00b2230 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fedf006dc50 tx=0x7fede402c800 comp rx=0 tx=0).stop 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedf64a5640 1 -- 172.21.15.87:0/1765812322 shutdown_connections 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedf64a5640 1 --2- 172.21.15.87:0/1765812322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b2770 0x7fedf0146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedf64a5640 1 --2- 172.21.15.87:0/1765812322 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b5330 0x7fedf00b2230 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedf64a5640 1 --2- 172.21.15.87:0/1765812322 >> v2:172.21.15.110:3300/0 conn(0x7fedf00b5e60 0x7fedf00b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedf64a5640 1 -- 172.21.15.87:0/1765812322 >> 172.21.15.87:0/1765812322 conn(0x7fedf006c6a0 msgr2=0x7fedf006cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:43.092 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedf64a5640 1 -- 172.21.15.87:0/1765812322 shutdown_connections 2024-05-09T08:02:43.093 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.073+0000 7fedf64a5640 1 -- 172.21.15.87:0/1765812322 wait complete. 2024-05-09T08:02:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.074+0000 7fedf64a5640 1 Processor -- start 2024-05-09T08:02:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.074+0000 7fedf64a5640 1 -- start start 2024-05-09T08:02:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedf64a5640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b2770 0x7fedf01c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedf64a5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b5330 0x7fedf01d8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:43.095 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedf64a5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedf00b5e60 0x7fedf01c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedf64a5640 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 -- 0x7fedf00af960 con 0x7fedf00b2770 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedf64a5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fedf00afd40 con 0x7fedf00b5e60 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedf64a5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 -- 0x7fedf00afae0 con 0x7fedf00b5330 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedeffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b2770 0x7fedf01c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedeffff640 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b2770 0x7fedf01c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:52832/0 (socket says 172.21.15.87:52832) 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedeffff640 1 -- 172.21.15.87:0/2108842034 learned_addr learned my addr 172.21.15.87:0/2108842034 (peer_addr_for_me v2:172.21.15.87:0/0) 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedef7fe640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b5330 0x7fedf01d8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedf4a42640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedf00b5e60 0x7fedf01c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedeffff640 1 -- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b5330 msgr2=0x7fedf01d8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedeffff640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b5330 0x7fedf01d8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedeffff640 1 -- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedf00b5e60 msgr2=0x7fedf01c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedeffff640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedf00b5e60 0x7fedf01c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedeffff640 1 -- 172.21.15.87:0/2108842034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf009dc00 con 0x7fedf00b2770 2024-05-09T08:02:43.096 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedef7fe640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b5330 0x7fedf01d8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.075+0000 7fedf4a42640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedf00b5e60 0x7fedf01c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.076+0000 7fedeffff640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b2770 0x7fedf01c9220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fede000c7f0 tx=0x7fede000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.076+0000 7fedecff9640 1 -- 172.21.15.87:0/2108842034 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0015070 con 0x7fedf00b2770 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.076+0000 7fedecff9640 1 -- 172.21.15.87:0/2108842034 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fede00077c0 con 0x7fedf00b2770 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.076+0000 7fedecff9640 1 -- 172.21.15.87:0/2108842034 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0007b90 con 0x7fedf00b2770 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.076+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf009c880 con 0x7fedf00b2770 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.076+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf009cb20 con 0x7fedf00b2770 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.077+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf009e360 con 0x7fedf00b2770 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.077+0000 7fedecff9640 1 -- 172.21.15.87:0/2108842034 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fede0018070 con 0x7fedf00b2770 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.078+0000 7fedecff9640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7feddc06be30 0x7feddc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.078+0000 7fedecff9640 1 -- 172.21.15.87:0/2108842034 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5502+0+0 (secure 0 0 0) 0x7fede008adc0 con 0x7fedf00b2770 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.078+0000 7fedef7fe640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7feddc06be30 0x7feddc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T08:02:43.097 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.078+0000 7fedef7fe640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7feddc06be30 0x7feddc06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fede4037000 tx=0x7fede4032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T08:02:43.099 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.082+0000 7fedecff9640 1 -- 172.21.15.87:0/2108842034 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fede0059840 con 0x7fedf00b2770 2024-05-09T08:02:43.275 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.259+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fedf0071580 con 0x7fedf00b2770 2024-05-09T08:02:43.955 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.939+0000 7fedecff9640 1 -- 172.21.15.87:0/2108842034 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7fede0059140 con 0x7fedf00b2770 2024-05-09T08:02:43.956 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'cephfs_data' removed 2024-05-09T08:02:43.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7feddc06be30 msgr2=0x7feddc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:43.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7feddc06be30 0x7feddc06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fede4037000 tx=0x7fede4032000 comp rx=0 tx=0).stop 2024-05-09T08:02:43.960 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b2770 msgr2=0x7fedf01c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T08:02:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b2770 0x7fedf01c9220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fede000c7f0 tx=0x7fede000ccb0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 shutdown_connections 2024-05-09T08:02:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:6832/1321160324,v1:172.21.15.87:6833/1321160324] conn(0x7feddc06be30 0x7feddc06e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedf00b5330 0x7fedf01d8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedf00b5e60 0x7fedf01c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 --2- 172.21.15.87:0/2108842034 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fedf00b2770 0x7fedf01c9220 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T08:02:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.943+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 >> 172.21.15.87:0/2108842034 conn(0x7fedf006c6a0 msgr2=0x7fedf00b8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T08:02:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.944+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 shutdown_connections 2024-05-09T08:02:43.961 INFO:teuthology.orchestra.run.smithi087.stderr:2024-05-09T08:02:43.944+0000 7fedf64a5640 1 -- 172.21.15.87:0/2108842034 wait complete. 2024-05-09T08:02:43.981 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-09T08:02:43.981 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T08:02:43.981 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:43.991 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T08:02:43.991 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T08:02:43.991 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.000 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T08:02:44.001 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-09T08:02:44.001 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-09T08:02:44.001 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.066 INFO:tasks.ceph.osd.0:Stopped 2024-05-09T08:02:44.067 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-09T08:02:44.067 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.139 INFO:tasks.ceph.osd.1:Stopped 2024-05-09T08:02:44.139 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-09T08:02:44.139 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.215 INFO:tasks.ceph.osd.2:Stopped 2024-05-09T08:02:44.215 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-09T08:02:44.215 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.289 INFO:tasks.ceph.osd.3:Stopped 2024-05-09T08:02:44.290 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-09T08:02:44.290 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.333 INFO:tasks.ceph.osd.4:Stopped 2024-05-09T08:02:44.333 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-09T08:02:44.334 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.368 INFO:tasks.ceph.osd.5:Stopped 2024-05-09T08:02:44.368 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-09T08:02:44.368 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.451 INFO:tasks.ceph.osd.6:Stopped 2024-05-09T08:02:44.452 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-09T08:02:44.452 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.499 INFO:tasks.ceph.osd.7:Stopped 2024-05-09T08:02:44.499 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-09T08:02:44.499 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-09T08:02:44.499 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.528 INFO:tasks.ceph.mgr.y:Stopped 2024-05-09T08:02:44.528 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-09T08:02:44.529 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.556 INFO:tasks.ceph.mgr.x:Stopped 2024-05-09T08:02:44.556 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-09T08:02:44.556 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-09T08:02:44.556 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.580 INFO:tasks.ceph.mon.a:Stopped 2024-05-09T08:02:44.581 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-09T08:02:44.581 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.610 INFO:tasks.ceph.mon.b:Stopped 2024-05-09T08:02:44.610 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-09T08:02:44.610 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T08:02:44.663 INFO:tasks.ceph.mon.c:Stopped 2024-05-09T08:02:44.663 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-09T08:02:44.664 DEBUG:teuthology.orchestra.run.smithi087:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-09T08:02:44.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T08:02:44.710 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-09T08:02:44.937 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T08:02:44.937 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-09T08:02:45.090 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T08:02:45.091 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-09T08:02:45.140 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T08:02:45.140 DEBUG:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-09T08:02:45.190 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T08:02:45.190 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-09T08:02:45.435 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T08:02:45.435 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-09T08:02:45.514 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T08:02:45.514 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-09T08:02:45.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T08:02:45.571 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-09T08:02:45.631 INFO:tasks.ceph:Archiving mon data... 2024-05-09T08:02:45.632 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/data/mon.a.tgz 2024-05-09T08:02:45.632 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-05-09T08:02:45.649 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.2NV2lcRuIo 2024-05-09T08:02:45.649 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2NV2lcRuIo 2024-05-09T08:02:45.796 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.2NV2lcRuIo 2024-05-09T08:02:45.938 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.2NV2lcRuIo is 351KB 2024-05-09T08:02:46.033 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.2NV2lcRuIo 2024-05-09T08:02:46.048 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/data/mon.b.tgz 2024-05-09T08:02:46.048 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-05-09T08:02:46.065 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.w84CypHDnG 2024-05-09T08:02:46.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.w84CypHDnG 2024-05-09T08:02:46.238 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.w84CypHDnG 2024-05-09T08:02:46.322 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.w84CypHDnG is 463KB 2024-05-09T08:02:46.391 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.w84CypHDnG 2024-05-09T08:02:46.406 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/data/mon.c.tgz 2024-05-09T08:02:46.407 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-05-09T08:02:46.461 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.WwBS7fetM9 2024-05-09T08:02:46.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.WwBS7fetM9 2024-05-09T08:02:46.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.WwBS7fetM9 2024-05-09T08:02:46.699 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.WwBS7fetM9 is 463KB 2024-05-09T08:02:46.769 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.WwBS7fetM9 2024-05-09T08:02:46.784 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-09T08:02:46.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T08:02:46.787 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T08:02:46.885 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T08:02:46.903 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T08:02:46.903 INFO:tasks.ceph:Archiving crash dumps... 2024-05-09T08:02:46.905 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/remote/smithi087/crash 2024-05-09T08:02:46.906 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T08:02:46.952 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/remote/smithi110/crash 2024-05-09T08:02:46.953 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T08:02:46.976 INFO:tasks.ceph:Shutting down logrotate 2024-05-09T08:02:46.976 DEBUG:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T08:02:46.997 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T08:02:47.064 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T08:02:47.099 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T08:02:47.129 INFO:tasks.ceph:Compressing logs... 2024-05-09T08:02:47.129 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T08:02:47.142 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43209.log 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145425.log 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145551.log 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41751.log 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145551.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145425.log.gz 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43209.log.gz 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43495.log 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.145551.log.gz 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145173.log 2024-05-09T08:02:47.183 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145383.log 2024-05-09T08:02:47.208 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T08:02:47.208 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35528.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.35528.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35528.log.gz 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35448.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.35448.log: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35448.log.gz 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35488.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.c.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35408.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.35488.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-09T08:02:47.209 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3%/var/log/ceph/ceph-client.admin.35408.log: -- replaced with /var/log/ceph/ceph-client.admin.35488.log.gz 2024-05-09T08:02:47.210 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35368.log 2024-05-09T08:02:47.210 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35408.log.gz 2024-05-09T08:02:47.210 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35319.log 2024-05-09T08:02:47.210 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.35368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35237.log 2024-05-09T08:02:47.210 INFO:teuthology.orchestra.run.smithi110.stderr: 87.2%/var/log/ceph/ceph-client.admin.35319.log: -- replaced with /var/log/ceph/ceph-client.admin.35368.log.gz 2024-05-09T08:02:47.210 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35319.log.gz 2024-05-09T08:02:47.210 INFO:teuthology.orchestra.run.smithi110.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-09T08:02:47.216 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-09T08:02:47.216 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.35237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35277.log 2024-05-09T08:02:47.216 INFO:teuthology.orchestra.run.smithi110.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35237.log.gz 2024-05-09T08:02:47.216 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.35277.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35277.log.gz 2024-05-09T08:02:47.234 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144250.log 2024-05-09T08:02:47.234 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.145173.log.gz 2024-05-09T08:02:47.234 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T08:02:47.234 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145383.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43495.log.gz 2024-05-09T08:02:47.234 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42540.log 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145383.log.gz 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144250.log.gz 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41656.log 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42874.log 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42874.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43873.log: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41298.log 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146084.log 2024-05-09T08:02:47.235 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144166.log 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.146084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42879.log 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145089.log 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146084.log.gz 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42879.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144166.log.gz 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146187.log 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145089.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2%/var/log/ceph/ceph-client.admin.146187.log: -- replaced with /var/log/ceph/ceph-client.admin.145089.log.gz 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42542.log 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.146187.log.gz 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145467.log 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44567.log 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144292.log 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.145467.log.gz 2024-05-09T08:02:47.236 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.44567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144654.log 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144292.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41656.log.gz 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41923.log 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.144292.log.gz 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42539.log 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41751.log.gz 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41923.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144654.log.gz 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145916.log 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146145.log 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145719.log 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.145916.log.gz 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.146145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41528.log 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146145.log.gz 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145834.log 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145719.log.gz 2024-05-09T08:02:47.237 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41528.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145761.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145834.log.gz 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42536.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145761.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41528.log.gz 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41221.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42536.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145761.log.gz 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43211.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144780.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42532.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145215.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.144780.log.gz 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42862.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43789.log 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr: 87.8%/var/log/ceph/ceph-client.admin.42862.log: -- replaced with /var/log/ceph/ceph-client.admin.145215.log.gz 2024-05-09T08:02:47.238 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35706.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41360.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145005.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41360.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145005.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.145005.log.gz 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41129.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43747.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42542.log.gz 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42361.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42540.log.gz 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144123.log 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43211.log.gz 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43747.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42532.log.gz 2024-05-09T08:02:47.239 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35448.log 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43789.log.gz 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144386.log 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144123.log.gz 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43957.log 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42536.log.gz 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144386.log: gzip -5 89.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43747.log.gz 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr: /var/log/ceph/ceph-client.admin.43213.log 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43957.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144386.log.gz 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42067.log 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42361.log.gz 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42541.log 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42876.log 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42539.log.gz 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42541.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42862.log.gz 2024-05-09T08:02:47.240 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144470.log 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42876.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42874.log.gz 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41612.log 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144470.log.gz 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42025.log 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-mon.a.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35448.log.gz 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6%/var/log/ceph/ceph-client.admin.41612.log: -- replaced with /var/log/ceph/ceph-client.admin.43213.log.gz 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44041.log 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42067.log.gz 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42541.log.gz 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42193.log 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.44041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43453.log 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42193.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42876.log.gz 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43537.log 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41612.log.gz 2024-05-09T08:02:47.241 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43411.log 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43537.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42025.log.gz 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43212.log 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42193.log.gz 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43621.log 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43411.log: /var/log/ceph/ceph-client.admin.43212.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42879.log.gz 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145299.log 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144554.log 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43831.log 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145299.log.gz 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145874.log 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43831.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144554.log.gzgzip 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.145635.log 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43453.log.gz 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42877.log 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.145874.log.gz 2024-05-09T08:02:47.242 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144612.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43537.log.gz 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145635.log.gz 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41444.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43999.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144612.log.gz 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145047.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:gzip/var/log/ceph/ceph-client.admin.43999.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.145341.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43663.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41983.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.145047.log.gz 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145341.log.gz 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42277.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43663.log: /var/log/ceph/ceph-client.admin.41983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146042.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43411.log.gz 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42872.log 2024-05-09T08:02:47.243 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.146042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145677.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42872.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146042.log.gz 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145257.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42875.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41486.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145677.log.gz 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5%/var/log/ceph/ceph-client.admin.42875.log: -- replaced with /var/log/ceph/ceph-client.admin.145257.log.gz 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43579.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43215.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41839.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43212.log.gz 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144208.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145509.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42151.log 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144208.log.gz 2024-05-09T08:02:47.244 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41402.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41881.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145509.log.gz 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41570.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144738.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43075.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144512.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144738.log: /var/log/ceph/ceph-client.admin.43075.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144738.log.gzgzip 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.145131.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144963.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144512.log: /var/log/ceph/ceph-client.admin.145131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42861.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144512.log.gz 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144963.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.145131.log.gz 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.145958.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144963.log.gz 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35825.log 2024-05-09T08:02:47.245 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41700.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.145958.log.gz 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.35825.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41793.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41700.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144914.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.41793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42109.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44143.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144914.log: /var/log/ceph/ceph-client.admin.42109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145593.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.144914.log.gz 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.44143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43705.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.145593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43915.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.145593.log.gz 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43214.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43705.log: /var/log/ceph/ceph-client.admin.43915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42543.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2024-05-09T08:02:47.246 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42235.log 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42543.log: /var/log/ceph/ceph-client.admin.42535.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29574.log 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.42235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43210.log 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph.tmp-client.admin.29574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144428.log 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29574.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144696.log 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.43210.log: /var/log/ceph/ceph-client.admin.144428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146000.log 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.144696.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144428.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144696.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.admin.146000.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.146000.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43621.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43831.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42877.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43663.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42277.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42872.log.gz 2024-05-09T08:02:47.247 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35825.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42875.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43579.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35706.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43215.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42543.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42861.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42109.log.gz 2024-05-09T08:02:47.248 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42151.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42235.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41570.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41700.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41793.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43075.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43214.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43210.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43705.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43915.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44143.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43957.log.gz 2024-05-09T08:02:47.250 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43999.log.gz 2024-05-09T08:02:47.251 INFO:teuthology.orchestra.run.smithi087.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44041.log.gz 2024-05-09T08:02:47.251 INFO:teuthology.orchestra.run.smithi087.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41444.log.gz 2024-05-09T08:02:47.251 INFO:teuthology.orchestra.run.smithi087.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41486.log.gz 2024-05-09T08:02:47.256 INFO:teuthology.orchestra.run.smithi087.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41129.log.gz 2024-05-09T08:02:47.256 INFO:teuthology.orchestra.run.smithi087.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41221.log.gz 2024-05-09T08:02:47.256 INFO:teuthology.orchestra.run.smithi087.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41298.log.gz 2024-05-09T08:02:47.256 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41360.log.gz 2024-05-09T08:02:47.256 INFO:teuthology.orchestra.run.smithi087.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41402.log.gz 2024-05-09T08:02:47.256 INFO:teuthology.orchestra.run.smithi087.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41839.log.gz 2024-05-09T08:02:47.257 INFO:teuthology.orchestra.run.smithi087.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41881.log.gz 2024-05-09T08:02:47.257 INFO:teuthology.orchestra.run.smithi087.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41923.log.gz 2024-05-09T08:02:47.257 INFO:teuthology.orchestra.run.smithi087.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41983.log.gz 2024-05-09T08:02:47.257 INFO:teuthology.orchestra.run.smithi087.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T08:02:47.313 INFO:teuthology.orchestra.run.smithi110.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-09T08:02:47.350 INFO:teuthology.orchestra.run.smithi110.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-09T08:02:47.551 INFO:teuthology.orchestra.run.smithi087.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-09T08:02:48.314 INFO:teuthology.orchestra.run.smithi087.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-09T08:02:48.906 INFO:teuthology.orchestra.run.smithi110.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-09T08:02:49.129 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-09T08:02:49.496 INFO:teuthology.orchestra.run.smithi110.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-09T08:02:49.859 INFO:teuthology.orchestra.run.smithi110.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-09T08:02:49.861 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-05-09T08:02:49.861 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m2.677s 2024-05-09T08:02:49.861 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m8.566s 2024-05-09T08:02:49.861 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.327s 2024-05-09T08:02:50.720 INFO:teuthology.orchestra.run.smithi087.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-09T08:02:51.696 INFO:teuthology.orchestra.run.smithi087.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-09T08:02:52.737 INFO:teuthology.orchestra.run.smithi087.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-09T08:02:53.210 INFO:teuthology.orchestra.run.smithi087.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-09T08:03:41.872 INFO:teuthology.orchestra.run.smithi087.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-09T08:04:49.441 INFO:teuthology.orchestra.run.smithi087.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.0.44567.log.gz 2024-05-09T08:04:49.445 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-05-09T08:04:49.445 INFO:teuthology.orchestra.run.smithi087.stderr:real 2m2.289s 2024-05-09T08:04:49.445 INFO:teuthology.orchestra.run.smithi087.stderr:user 2m55.294s 2024-05-09T08:04:49.445 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m6.068s 2024-05-09T08:04:49.446 INFO:tasks.ceph:Archiving logs... 2024-05-09T08:04:49.446 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/remote/smithi087/log 2024-05-09T08:04:49.447 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T08:05:30.068 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/remote/smithi110/log 2024-05-09T08:05:30.069 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T08:05:31.415 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T08:05:31.428 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T08:05:31.428 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T08:05:31.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T08:05:31.527 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T08:05:31.537 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T08:05:31.537 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T08:05:31.540 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T08:05:31.555 INFO:teuthology.orchestra.run.smithi087.stderr:bash: line 1: ntpq: command not found 2024-05-09T08:05:31.557 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-05-09T08:05:31.561 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T08:05:31.561 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-05-09T08:05:31.561 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +863us[ +870us] +/- 62ms 2024-05-09T08:05:31.562 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -534us[ -527us] +/- 55ms 2024-05-09T08:05:31.562 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -332us[ -324us] +/- 87ms 2024-05-09T08:05:31.562 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T08:05:31.570 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T08:05:31.570 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-05-09T08:05:31.570 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +818us[ +820us] +/- 62ms 2024-05-09T08:05:31.570 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -595us[ -593us] +/- 55ms 2024-05-09T08:05:31.571 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -381us[ -378us] +/- 87ms 2024-05-09T08:05:31.571 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T08:05:31.572 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T08:05:31.582 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T08:05:31.583 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T08:05:31.594 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T08:05:31.701 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T08:05:31.767 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T08:05:31.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T08:05:31.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T08:05:31.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T08:05:31.828 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T08:05:31.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T08:05:31.849 INFO:teuthology.task.internal:Duration was 1089.884706 seconds 2024-05-09T08:05:31.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T08:05:31.862 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T08:05:31.862 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T08:05:31.865 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T08:05:31.909 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T08:05:31.923 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T08:05:32.234 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T08:05:32.234 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-05-09T08:05:32.235 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T08:05:32.256 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-05-09T08:05:32.256 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T08:05:32.284 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T08:05:32.285 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T08:05:32.298 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T08:05:32.352 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T08:05:32.352 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T08:05:32.365 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T08:05:32.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T08:05:32.500 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T08:05:32.500 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T08:05:32.535 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T08:05:32.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T08:05:32.572 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T08:05:32.577 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T08:05:32.604 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-05-09T08:05:32.623 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-05-09T08:05:32.640 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T08:05:32.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T08:05:32.673 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T08:05:32.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T08:05:32.695 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T08:05:32.705 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T08:05:32.707 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/remote/smithi087 2024-05-09T08:05:32.707 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T08:05:32.747 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-08_21:24:04-fs-squid-distro-default-smithi/7698636/remote/smithi110 2024-05-09T08:05:32.747 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T08:05:32.780 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T08:05:32.780 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T08:05:32.783 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T08:05:32.830 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T08:05:32.844 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T08:05:32.844 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T08:05:32.856 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T08:05:32.856 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T08:05:32.859 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T08:05:32.871 INFO:teuthology.orchestra.run.smithi087.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 08:05 /home/ubuntu/cephtest 2024-05-09T08:05:32.885 INFO:teuthology.orchestra.run.smithi110.stdout: 265427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 08:05 /home/ubuntu/cephtest 2024-05-09T08:05:32.887 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T08:05:32.898 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T08:05:32.926 INFO:teuthology.run:Summary data: description: fs/traceless/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_blogbench traceless/50pc} duration: 1089.8847060203552 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-05-09T08:05:32.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T08:05:32.998 INFO:teuthology.run:pass